-- Logs begin at Wed 2022-06-22 08:01:08 UTC, end at Wed 2022-06-22 09:23:34 UTC. -- Jun 22 08:51:48.064394 dv-cinder-787296-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 08:51:48.073041 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:51:48 2022] *** Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: nodename: dv-cinder-787296-11-iscsi Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: machine: x86_64 Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: clock source: unix Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: pcre jit disabled Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: detected number of CPU cores: 4 Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: current working directory: / Jun 22 08:51:48.075057 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:51:48.075787 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: your processes number limit is 47680 Jun 22 08:51:48.075787 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: your memory page size is 4096 bytes Jun 22 08:51:48.075787 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: detected max file descriptor number: 2048 Jun 22 08:51:48.075787 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: lock engine: pthread robust mutexes Jun 22 08:51:48.075787 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: thunder lock: enabled Jun 22 08:51:48.075787 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 08:51:48.075787 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:51:48.119713 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: Python main interpreter initialized at 0x555683a8c9c0 Jun 22 08:51:48.119713 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: python threads support enabled Jun 22 08:51:48.119713 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: your server socket listen backlog is limited to 100 connections Jun 22 08:51:48.119713 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:51:48.120020 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:51:48.120093 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: *** Operational MODE: preforking *** Jun 22 08:51:48.120315 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:51:48.120315 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: spawned uWSGI master process (pid: 103496) Jun 22 08:51:48.120506 dv-cinder-787296-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 08:51:48.126081 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: spawned uWSGI worker 1 (pid: 103497, cores: 1) Jun 22 08:51:48.126081 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: spawned uWSGI worker 2 (pid: 103498, cores: 1) Jun 22 08:51:48.126081 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:51:48.789035 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:51:48.795123 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:51:49.943534 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:51:49.943534 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: from cryptography.utils import int_from_bytes Jun 22 08:51:49.944214 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:51:49.944214 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: from cryptography.utils import int_from_bytes Jun 22 08:51:49.996638 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:51:49.996638 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: from cryptography.utils import int_from_bytes Jun 22 08:51:49.997191 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:51:49.997191 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: from cryptography.utils import int_from_bytes Jun 22 08:51:52.462167 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:51:52.462830 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:51:52.462931 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:51:52.463278 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:51:52.463532 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:51:52.463915 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.464238 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.464558 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.464874 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.465200 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.465510 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.465826 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.466167 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.466494 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.466752 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.467061 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.467387 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-11-iscsi {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.467703 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.468007 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.468311 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.468627 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.468927 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.469247 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.469547 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.469931 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:51:52.470359 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.470519 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:51:52.470631 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.470746 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:51:52.470857 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.471083 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:51:52.471205 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.471322 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:51:52.471427 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.471711 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.471809 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.472011 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.472093 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.472326 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.472462 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.472631 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.472722 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.472949 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.473083 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.473253 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.473344 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.473676 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.473790 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-11-iscsi {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.474142 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.474358 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.474442 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.474571 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.474724 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.474863 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.475138 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.475262 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.475437 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.475532 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-11-iscsi {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.475747 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.475845 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.476061 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.476152 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.476373 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.476457 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.476671 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.476756 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.476985 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.477070 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.477302 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.477382 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.477613 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.477696 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.477924 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.478134 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.478233 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.478447 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.478532 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.478751 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.478834 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.479060 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.479175 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.479394 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.479488 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.479707 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.479797 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.479953 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.480045 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.480256 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.480346 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.480571 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.480667 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.480887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.480970 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.481209 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.481306 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.481458 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.481596 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-11-iscsi {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.481694 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.481911 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.482012 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.482248 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.482343 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.482562 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.482646 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.482919 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.483013 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.483222 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.483312 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.483526 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.483612 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.483829 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.483992 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.484131 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.484238 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.484434 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.484526 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.484737 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.484829 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.485050 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.485135 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.485362 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.485457 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.485675 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.485804 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.485975 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.486097 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.486304 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.486389 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.486614 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.486706 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.486930 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.487013 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.487233 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.487316 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.487543 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.487628 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.487793 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.487878 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.488097 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.488190 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.488416 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.488500 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.488735 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.488818 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.489044 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.489166 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.489351 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.489541 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.489636 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.489848 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.489934 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.490191 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.490281 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.490498 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.490596 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.490802 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.490895 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.491050 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.491131 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.491349 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.491444 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.491650 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.491749 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.491967 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.492075 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.492269 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.492371 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.492568 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.492667 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.492870 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.492961 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.493167 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.493256 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.493476 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.493576 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.493771 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.493867 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.494088 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.494184 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.494398 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.494482 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.494701 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.494785 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495000 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495083 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495301 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495446 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495600 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495684 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495898 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.495982 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.496210 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.496294 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.496522 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.496604 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.496822 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.496905 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.497122 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.497211 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.497424 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.497514 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.497724 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.497807 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498039 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498143 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498364 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498447 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498614 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498699 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498911 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.498995 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.499211 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.499296 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.499525 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.499617 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.499826 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.499919 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.500126 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.500215 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.500426 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.500516 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.500722 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.500805 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.501018 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.501100 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.501319 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.501408 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.501880 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.501970 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.502205 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.502300 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.502505 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.502597 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.502803 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.502892 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.503099 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.503187 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.503398 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.503488 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.503695 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.503783 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.503992 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.504086 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.504291 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.504375 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.504585 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.504682 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.505476 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.505634 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.505790 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.505875 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.506115 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.506216 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.506443 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.506616 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.506732 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.506817 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.507030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.507113 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.507351 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.507435 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.507653 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.507743 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.507953 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.508043 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.508267 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.508357 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.508569 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.508653 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.508870 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.508954 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.509185 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.509276 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.509481 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.509603 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.509784 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.509869 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.510114 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.510214 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.510421 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.510514 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.510723 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.510806 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.511021 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.511178 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.511319 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.511403 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.511617 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.511700 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.511916 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.512011 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.512213 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.512296 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.512511 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.512595 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.512808 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.512893 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.513121 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.513206 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.513437 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.513520 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.513745 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.513829 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.514047 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.514140 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.514368 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.514459 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.514685 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:51:52.514770 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.515017 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.515108 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.515338 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.515427 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.515661 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.515791 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.515976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.516059 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.516282 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.516364 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.516590 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.516675 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.516896 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.516980 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.517215 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.517298 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.517524 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.517607 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.517845 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.517931 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.518188 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.518293 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.518490 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.518573 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.518794 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.518876 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.519098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.519194 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.519407 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.519498 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.519717 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.519801 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.520028 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.520120 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.520338 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.520651 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.520817 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.520912 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.521043 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.521138 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.521887 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.522002 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.522230 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.522365 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.522544 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.522638 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.522855 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.522944 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.523163 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.523248 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.523468 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.523553 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.523774 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.523870 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.524081 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.524164 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.524386 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.524470 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.524705 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.524796 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.525021 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.525103 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.525325 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.525417 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.525642 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.525724 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.525950 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.526039 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.526286 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.526381 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.526596 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.526679 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.526902 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.526995 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.527204 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.527287 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.527508 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.527591 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.527815 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.527906 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.528119 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.528202 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.528438 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.528529 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.528745 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.528838 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.529049 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.529134 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.529354 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.529445 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.529662 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.529794 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.529967 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.530049 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.530299 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.530385 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.530606 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.530690 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.530906 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.530987 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.531208 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.531291 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.531511 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.531605 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.531816 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.531899 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.532117 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.532200 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.532427 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.532512 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.532749 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.532839 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.533055 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.533138 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.533367 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.533457 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.533673 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.533755 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.533979 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.534176 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.534309 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.534395 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.534615 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.534704 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.534916 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.535010 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.535218 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.535302 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.535520 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.535610 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.535821 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.535912 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.536187 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.536280 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.536455 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.536588 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.536755 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.536847 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.537075 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.537160 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.537381 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.537471 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.537681 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.537773 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.537990 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.538094 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.538322 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.538414 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.538630 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.538714 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.538932 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.539014 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.539250 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.539346 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.539552 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.539636 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.539864 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.539947 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.540175 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.540258 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.540507 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.540591 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.540825 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.540908 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.541129 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.541219 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.541445 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.541536 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.541759 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.541850 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.542080 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.542179 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.542383 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.542466 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.542692 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.542782 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.542995 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.543092 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.543298 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.543414 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.543602 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.543693 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.543907 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.544004 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.544209 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.544340 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.544514 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.544598 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.544817 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.544908 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.545117 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.545201 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.545419 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.545502 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.545740 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.545825 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.546046 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.546184 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.546371 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.546456 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.546674 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.546763 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.546974 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.547057 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.547315 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.547400 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.547618 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.547704 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.547922 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.548005 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.548231 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.548314 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.548541 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.548625 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.548849 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.548942 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.549171 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.549262 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.549483 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.549568 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.549790 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.549873 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.550113 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.550214 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.550428 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.550511 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.550734 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.550816 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.551050 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.551141 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.551352 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.551444 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.551704 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.551827 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.552066 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.552195 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.552475 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.552559 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.552789 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.552908 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.553110 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.553194 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.553418 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.553501 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.553726 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.553808 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.554033 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.554182 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.554365 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.554449 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.554670 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.554756 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.554972 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.555128 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.555278 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.555362 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.555587 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.555671 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.555893 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.555986 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.556199 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.556318 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.556499 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.556589 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.556805 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.556894 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.557115 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.557196 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.557427 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.557518 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.557729 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.557814 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.558033 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.558168 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.558375 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.558470 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.558680 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.558762 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.558996 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.559079 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.559299 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.559395 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.559604 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.559685 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.559906 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.559989 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.560228 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.560324 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.560534 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.560616 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.560834 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.560953 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.561136 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.561220 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.561437 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.561521 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.561741 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.561830 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.562049 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.562152 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.562375 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.562460 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.562677 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.562761 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.562984 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.563070 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.563290 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.563372 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.563594 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.563682 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.563900 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.563984 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.564200 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.564290 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.564511 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.564603 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.564816 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.564910 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.565121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.565204 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.565420 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.565510 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.565731 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.565840 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.566042 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.566164 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.566372 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.566490 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.566690 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.566780 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.566998 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.567082 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.567819 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.567922 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.568130 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.568233 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.568432 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.568549 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.568740 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.568861 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.569054 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.569165 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.569469 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.569619 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.569772 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.569952 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.570133 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.570306 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.570444 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.570624 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.570752 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.570943 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.571067 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.571262 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.571386 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.571593 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.571689 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.571919 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.572003 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.572261 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.572374 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.572568 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.572658 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.572876 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.572960 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.573179 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.573261 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.573483 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.573566 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.573791 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.573874 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.574118 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.574215 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.574427 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.574533 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.574731 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.574826 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.575064 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.575156 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.575341 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.575438 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.575646 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.575730 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.575950 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.576051 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.576257 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.576349 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.576559 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.576648 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.576862 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.576943 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.577173 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.577423 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.577509 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.577754 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.577837 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.578140 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.578239 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.578403 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.578487 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.578708 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.578793 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.579009 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.579101 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.579337 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.579419 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.579638 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.579721 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.579973 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.580068 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.580275 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.580370 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.580583 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.580675 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.580891 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.580982 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.581193 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.581285 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.581500 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.581590 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.581801 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.581886 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.582120 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.582206 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.582423 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.582504 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.582729 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.582826 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.583551 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.583719 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.583855 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.584157 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.584241 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.584460 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.584554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.584769 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.584860 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.585071 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.585163 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.585379 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.585463 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.585680 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.585761 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.585988 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.586116 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.586319 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.586403 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.586622 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.586712 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.586923 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.587016 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.587225 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.587314 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.587528 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.587612 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.587836 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.587997 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.588144 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.588229 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.588453 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.588536 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.588761 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.588852 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.589063 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.589146 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.589380 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.589463 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.589685 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.589777 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.589991 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.590094 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.590377 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.590487 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.590657 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.590743 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.590964 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.591047 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.591265 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.591349 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.591588 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.591673 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.591899 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.591982 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.592202 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.592285 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.592506 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.592608 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.592810 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.592892 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.593111 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.593193 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.593413 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.593497 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.593712 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.593794 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.594027 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.594142 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.594367 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.594457 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.594667 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.594756 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.594971 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.595067 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.595271 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.595354 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.595574 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.595657 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.595874 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.595964 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.596177 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.596258 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.596478 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.596560 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.596777 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.596867 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.597078 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.597162 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.597381 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.597471 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.597681 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.597771 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.597986 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.598097 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.598319 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.598403 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.598659 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.598748 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.598962 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.599236 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.599323 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.599564 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.599661 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.599873 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.599957 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.600177 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.600260 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.600489 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.600610 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.600798 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.600895 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.601100 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.601184 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.601408 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.601494 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.601715 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.601798 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.602026 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.602147 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.602352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.602445 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.602659 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.602744 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.602963 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.603047 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.603267 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.603352 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.603566 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.603650 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.603868 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.603952 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.604167 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.604250 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.604469 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.604554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.604769 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.604862 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.605073 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.605166 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.605373 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.605456 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.605693 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.605792 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.605994 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.606101 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.606328 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.606428 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.606628 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.606718 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.606926 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.607013 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.607231 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.607314 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.607538 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.607631 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.607848 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.607931 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.608158 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.608242 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.608473 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.608564 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.608784 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.608867 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.609090 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.609173 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.609395 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.609486 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.609702 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.609787 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.610003 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.610151 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.610332 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.610429 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.610640 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.610733 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.610945 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.611029 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.611248 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.611339 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.611546 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.611628 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.611845 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.611936 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.612154 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.612245 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.612456 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.612547 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.612771 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.612861 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.613091 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.613175 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.613414 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.613496 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.613717 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.613808 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.614023 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.614142 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.614432 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.614551 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.614748 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.614867 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.615060 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.615177 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.615365 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.615484 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.615781 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.615877 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.616092 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.616175 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.616399 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.616482 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.616708 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.616793 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.617008 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.617099 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.617313 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.617397 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.617617 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.617701 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.617922 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.618005 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.618250 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.618336 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.618561 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.618645 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.618864 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.618947 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.619165 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.619248 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.619471 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.619556 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.619772 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.619856 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.620081 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.620173 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.620384 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.620468 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.620775 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.620877 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.621104 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.621201 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.621412 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.621503 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.621714 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.621797 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.622019 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.622135 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.622350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.622434 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.622665 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.622749 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.622976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.623061 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.623277 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.623412 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.623604 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.623750 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.623927 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.624013 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.624251 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.624334 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.624562 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.624645 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.624863 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.624947 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.625164 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.625253 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.625470 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.625552 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.625791 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.625884 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.626117 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.626206 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.626421 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.626774 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.626990 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.627102 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.627311 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.627473 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.627616 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.627722 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.627932 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.628029 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.628344 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.628430 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.628650 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.628741 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.628952 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.629042 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.629259 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.629363 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.629563 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.629672 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.630421 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.630599 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.630816 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.630913 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.631053 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.631243 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.631371 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.631605 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.631700 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.631913 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.631998 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.632227 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.632312 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.632527 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.632611 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.632848 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.632933 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.633151 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.633244 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.633466 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.633549 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.633773 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.633857 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.634101 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.634200 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.634420 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.634514 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.634722 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.634805 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.635040 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.635132 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.635345 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.635431 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.635648 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.635744 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.635952 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.636064 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.636256 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.636374 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.636608 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.636696 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.636902 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.636994 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.637219 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.637303 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.637548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.637634 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.637877 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.637963 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.638199 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.638284 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.638507 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.638592 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.638829 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.638915 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.639133 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.639218 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.639441 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.639539 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.639750 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.639836 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.640052 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.640134 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.640352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.640443 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.640656 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.640741 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.640957 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.641052 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.641258 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.641360 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.641559 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.641652 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.641864 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.641948 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.642192 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.642325 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.642503 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.642602 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.642971 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.643127 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.643268 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.643648 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.643733 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.643953 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.644038 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.644259 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.644362 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.644563 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.644648 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.644874 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.644958 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.645183 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.645276 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.646038 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.646207 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.646412 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.646506 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.646719 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.646817 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.647054 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.647138 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.647374 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.647460 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.647696 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.647781 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.648025 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.648109 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.648335 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.648427 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.648659 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.648745 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.648964 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.649048 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.649290 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.649404 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.649575 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.649662 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.649878 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.649962 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.650208 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.650298 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.650513 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.650600 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.650821 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.650921 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.651119 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.651216 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.651409 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.651494 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.651710 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.651797 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.652028 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.652149 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.652330 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.652648 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.652735 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653001 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653095 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653288 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653377 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653591 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653676 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653891 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.653976 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.654253 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.654351 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.654557 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.654642 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.654888 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.654985 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.655204 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.655289 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.655523 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.655609 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.655846 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.655943 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.656158 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.656267 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.656477 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.656584 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.656791 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.656885 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.657111 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.657196 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.657427 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.657512 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.657738 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.657826 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.658050 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.658186 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.658383 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.658475 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.658698 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.658792 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.659004 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.659104 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.659318 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.659402 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.659629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.659729 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.659941 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.660047 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.660300 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.660484 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.660612 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.660813 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.660922 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.661290 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.661408 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.661561 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.661650 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.661868 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.661960 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.662199 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.662307 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.662514 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.662601 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.662873 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.662961 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.663198 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.663315 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.663548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.663642 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.663849 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.663935 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.664160 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.664253 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.664500 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.664627 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.664824 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.664913 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.665190 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.665390 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.665511 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.665722 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.665812 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.666036 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.666197 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.666429 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.666523 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.666756 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.666844 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.667073 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.667173 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.667393 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.667484 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.667717 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.667802 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.668027 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.668135 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.668339 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.668426 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.668649 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.668732 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.668952 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.669038 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.669297 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.669383 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.669627 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.669715 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.669937 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.670050 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.670264 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.670364 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.670585 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.670671 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.670893 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.670979 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.671238 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.671425 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.671605 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.671777 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.671928 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.672095 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.672242 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.672423 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.672556 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.672748 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.672870 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.673134 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.673388 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.673481 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.673699 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.673796 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.674051 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.674173 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.674382 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.674471 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.674707 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.674805 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.675015 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.675099 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.675319 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.675418 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.675647 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.675738 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.675951 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.676038 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.676256 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.676348 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.676558 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.676710 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.676990 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.677147 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.677312 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.677463 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.677608 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.677785 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.677902 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.678117 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.678235 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.678422 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.678543 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.678743 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.678855 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.679052 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.679221 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.679515 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.679603 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.679821 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.679954 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.680124 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.680289 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.680433 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.680638 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.680723 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.680963 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.681048 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.681279 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.681411 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.681586 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.681678 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.681907 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.681995 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.682236 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.682337 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.682541 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.682627 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.682856 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.682941 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.683166 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.683255 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.683470 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.683561 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.683771 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.683856 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.684079 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.684164 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.684383 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.684467 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.684684 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.684769 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.684989 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.685075 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.685289 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.685374 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.685612 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.685696 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.685917 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.686168 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.686270 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.686502 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.686587 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.686823 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.686909 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.687122 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.687212 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.687429 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.687514 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.687731 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.687825 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.688031 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.688116 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.688341 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.688428 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.688638 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.688771 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.688941 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.689034 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.689242 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.689327 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.689548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.689639 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.689848 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.689940 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.690178 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.690278 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.690489 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.690574 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.690795 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.690880 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.691103 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.691196 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.691405 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.691488 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.691710 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.691794 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.692018 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.692110 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.692858 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.692978 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.693168 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.693298 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.693478 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.693614 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.693819 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.693956 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.694156 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.694303 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.694624 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.694718 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.694940 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.695031 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.695259 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.695351 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.695572 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.695658 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.695882 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.695973 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.696194 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.696291 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.696505 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.696590 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.696821 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.696906 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.697140 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.697233 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.697451 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.697541 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.697758 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.697841 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.698093 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.698195 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.698392 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.698506 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.698700 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.698835 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.699007 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.699137 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.699314 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.699446 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.699620 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.699768 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.699924 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.700092 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.700227 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.700404 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.700532 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.700724 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.700837 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.701034 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.701143 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.701362 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.701454 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.701700 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.701793 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.702031 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.702192 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.702380 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.702466 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.702688 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.702774 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.702995 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.703087 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.703301 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.703385 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.703609 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.703695 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.703927 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.704011 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.704237 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.704321 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.704542 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.704628 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.704846 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.704931 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.705154 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.705238 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.705457 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.705547 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.705758 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.705872 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.706155 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.706260 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.706389 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.706510 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.706695 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.706821 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.706996 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.707128 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.707299 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.707454 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.707601 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.707774 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.707988 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.708711 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.708799 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.709034 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.709157 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.709344 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.709469 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.709673 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.709757 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.710009 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.710112 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.710362 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.710460 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.710684 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.710777 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.710990 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.711074 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.711293 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.711387 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.711597 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.711681 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.711903 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.711989 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.712268 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.712368 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.712531 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.712617 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.712833 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.712924 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.713133 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.713218 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.713437 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.713521 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.713739 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.713824 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.714040 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.714157 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.714361 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.714446 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.714664 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.714874 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.714975 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.715069 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.715256 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.715342 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.715555 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.715641 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.715854 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.715947 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.716154 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.716242 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.716455 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.716548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.716754 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.716839 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.717057 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.717148 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.717362 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.717526 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.717662 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.717754 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.717961 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.718046 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.718285 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.718385 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.718587 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.718672 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.718916 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.719001 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.719249 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.719334 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.719560 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.719652 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.719881 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.719966 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.720188 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.720281 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.720497 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.720581 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.720800 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.720891 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.721111 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.721195 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.721424 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.721515 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.721732 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.721815 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.722036 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.722179 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.722380 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.722464 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.722687 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.722778 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.722998 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.723083 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.723308 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.723393 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.723643 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.723740 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.724025 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.724179 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.724354 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.724501 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.724670 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.724829 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.724984 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.725142 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.725291 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.725451 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.725545 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:51:52.725779 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.726116 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.726440 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.726755 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.727065 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.727401 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.727711 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.728019 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.728333 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.728644 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.728955 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.729269 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.729582 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.729909 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.730266 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.730575 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.730903 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.731228 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.731573 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.731886 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.732227 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.732557 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.732870 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.733181 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.733484 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:51:52.733727 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:51:52.881704 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO dbcounter [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Registered counter for database nova_api Jun 22 08:51:52.889201 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO dbcounter [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Registered counter for database nova_api Jun 22 08:51:52.903565 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_db.sqlalchemy.engines [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:52.908952 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_db.sqlalchemy.engines [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:52.910174 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writer thread running {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:52.917287 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writer thread running {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:52.969715 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.context [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94958f18-576d-4472-bcc3-5e5788834e8e(cell1) {{(pid=103498) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:51:52.974595 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:51:52.975403 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.context [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94958f18-576d-4472-bcc3-5e5788834e8e(cell1) {{(pid=103497) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:51:52.976268 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:51:52.977059 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:51:52.979004 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:51:52.979350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_concurrency.lockutils [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:51:52.980930 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_concurrency.lockutils [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:51:52.981054 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO dbcounter [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Registered counter for database nova_cell0 Jun 22 08:51:52.981735 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_concurrency.lockutils [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:51:52.983739 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_concurrency.lockutils [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:51:52.985026 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO dbcounter [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Registered counter for database nova_cell1 Jun 22 08:51:52.985745 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO dbcounter [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Registered counter for database nova_cell0 Jun 22 08:51:52.989946 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO dbcounter [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Registered counter for database nova_cell1 Jun 22 08:51:52.992526 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_db.sqlalchemy.engines [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:52.994406 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_db.sqlalchemy.engines [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:52.997352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_db.sqlalchemy.engines [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:52.999607 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_db.sqlalchemy.engines [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:53.001248 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writer thread running {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:53.003017 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writer thread running {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:53.005341 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writer thread running {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:53.007134 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writer thread running {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:53.151973 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO dbcounter [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Registered counter for database nova_cell0 Jun 22 08:51:53.154764 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO dbcounter [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Registered counter for database nova_cell0 Jun 22 08:51:53.160805 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_db.sqlalchemy.engines [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:53.165024 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG oslo_db.sqlalchemy.engines [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:51:53.166029 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writer thread running {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:53.169472 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writer thread running {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:51:53.584778 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: WARNING keystonemiddleware.auth_token [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:51:53.591965 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: WARNING keystonemiddleware.auth_token [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:51:53.632226 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: WARNING keystonemiddleware.auth_token [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:51:53.639999 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: WARNING keystonemiddleware.auth_token [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:51:53.933757 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: WARNING keystonemiddleware.auth_token [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:51:53.939678 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: WARNING keystonemiddleware.auth_token [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:51:53.945127 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555683a8c9c0 pid: 103498 (default app) Jun 22 08:51:53.947219 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:51:53.948410 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 Jun 22 08:51:53.948818 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Jun 22 08:51:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:51:53.976758 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: WARNING keystonemiddleware.auth_token [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:51:53.982654 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: WARNING keystonemiddleware.auth_token [None req-aca990bd-ec8b-4eb5-9753-847a4107695c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:51:53.987912 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555683a8c9c0 pid: 103497 (default app) Jun 22 08:53:11.826549 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:11.827546 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 22 08:53:11.827937 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:11.842349 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writing DB stats nova_api:SELECT=3 {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:11.843485 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writing DB stats nova_cell0:SELECT=3 {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:11.844514 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writing DB stats nova_cell1:SELECT=3 {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:11.846469 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:12.293634 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-329bce5f-a546-4667-a7c6-7d19024ee3c4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:12.324160 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-329bce5f-a546-4667-a7c6-7d19024ee3c4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487957 Jun 22 08:53:12.324990 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 08:53:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:14.426139 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:14.427223 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-fa693408-168b-4579-a315-dbaa1f48159e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 22 08:53:14.427894 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:14.493996 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-3f53f7eb-248e-4afe-8fe6-618467370473 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:14.513283 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:53:14.513283 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: warnings.warn(msg) Jun 22 08:53:14.599462 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-3f53f7eb-248e-4afe-8fe6-618467370473 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.165036 Jun 22 08:53:14.600434 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:53:14.614022 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_api:SELECT=3 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:14.615217 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_cell0:SELECT=3 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:14.616231 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_cell1:SELECT=3 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:14.617241 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:14.821285 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-f62c3b9c-2f19-400c-bbad-1db8c89936f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:14.824384 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:53:14.824384 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: warnings.warn(msg) Jun 22 08:53:15.000396 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-f62c3b9c-2f19-400c-bbad-1db8c89936f2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.391212 Jun 22 08:53:15.001356 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 08:53:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:17.088945 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-3f53f7eb-248e-4afe-8fe6-618467370473 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:17.090021 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-3f53f7eb-248e-4afe-8fe6-618467370473 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 22 08:53:17.090463 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:17.205390 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-599d5cc7-2dc5-40c1-bf6f-1a3bdc0d8254 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "ram": 512}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:17.223420 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:53:17.223420 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: warnings.warn(msg) Jun 22 08:53:17.352195 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-599d5cc7-2dc5-40c1-bf6f-1a3bdc0d8254 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.254689 Jun 22 08:53:17.352674 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:53:17.365458 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-5cd0c914-5581-4030-b727-09123d868286 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:17.367037 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:53:17.367037 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: warnings.warn(msg) Jun 22 08:53:17.475218 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-5cd0c914-5581-4030-b727-09123d868286 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113821 Jun 22 08:53:17.475801 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 08:53:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:19.584670 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-599d5cc7-2dc5-40c1-bf6f-1a3bdc0d8254 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:19.585696 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-599d5cc7-2dc5-40c1-bf6f-1a3bdc0d8254 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 22 08:53:19.586355 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:19.651401 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-193ee789-d348-44b0-b92c-aef3fab72d87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:19.735135 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-193ee789-d348-44b0-b92c-aef3fab72d87 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142807 Jun 22 08:53:19.736206 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:53:19.748091 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-ddeed373-0b35-49ce-8fca-d5eb566f4f88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:19.847608 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-ddeed373-0b35-49ce-8fca-d5eb566f4f88 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103212 Jun 22 08:53:19.848357 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 08:53:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:21.957522 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-193ee789-d348-44b0-b92c-aef3fab72d87 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:21.958590 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-193ee789-d348-44b0-b92c-aef3fab72d87 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 22 08:53:21.959016 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:22.021236 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-582a6c91-a3b0-4208-a701-50e23c0bf38e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:22.104034 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-582a6c91-a3b0-4208-a701-50e23c0bf38e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138958 Jun 22 08:53:22.104512 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:53:22.116893 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-d41f3d15-a792-4101-9c6e-b9dc5dad3fd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:22.203688 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-d41f3d15-a792-4101-9c6e-b9dc5dad3fd8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090525 Jun 22 08:53:22.204276 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 08:53:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:24.328327 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-582a6c91-a3b0-4208-a701-50e23c0bf38e admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:24.329329 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-582a6c91-a3b0-4208-a701-50e23c0bf38e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 22 08:53:24.330519 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:24.392661 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-66afaae5-a715-4dc9-bc18-bd0ef0d1577c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:24.489212 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-66afaae5-a715-4dc9-bc18-bd0ef0d1577c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153011 Jun 22 08:53:24.490357 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:53:24.502759 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-cdf1aa7a-f493-4ed2-bb35-d704de8afe45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:24.607459 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-cdf1aa7a-f493-4ed2-bb35-d704de8afe45 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109267 Jun 22 08:53:24.608445 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Wed Jun 22 08:53:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:26.718983 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-66afaae5-a715-4dc9-bc18-bd0ef0d1577c admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:26.720037 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-66afaae5-a715-4dc9-bc18-bd0ef0d1577c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 22 08:53:26.720437 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:26.780681 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-bea80ca9-5589-494a-9d06-ed88dc7ce56c admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:26.804455 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-bea80ca9-5589-494a-9d06-ed88dc7ce56c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077429 Jun 22 08:53:26.805830 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 08:53:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:53:28.913846 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-66afaae5-a715-4dc9-bc18-bd0ef0d1577c admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:28.914876 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-66afaae5-a715-4dc9-bc18-bd0ef0d1577c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 22 08:53:28.915277 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:28.988659 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-52c9b041-1f35-40c4-a2e9-f1ef2184b478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:29.062534 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-52c9b041-1f35-40c4-a2e9-f1ef2184b478 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.141092 Jun 22 08:53:29.063075 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:53:29.075681 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-099c12df-14db-434b-bcec-7ace52a64ecb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:29.159670 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-099c12df-14db-434b-bcec-7ace52a64ecb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087440 Jun 22 08:53:29.160370 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 08:53:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 08:53:31.556373 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-52c9b041-1f35-40c4-a2e9-f1ef2184b478 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:31.557443 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-52c9b041-1f35-40c4-a2e9-f1ef2184b478 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 22 08:53:31.557848 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:31.624949 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-fde8d7a1-5ad7-490d-87fc-0b1f0f363f96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:31.710953 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-fde8d7a1-5ad7-490d-87fc-0b1f0f363f96 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.144743 Jun 22 08:53:31.711708 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:53:31.724022 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-ed588ac3-67e2-4252-9d75-5e9d959cbb10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:31.786159 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-ed588ac3-67e2-4252-9d75-5e9d959cbb10 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065842 Jun 22 08:53:31.786616 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 08:53:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:34.001426 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-fde8d7a1-5ad7-490d-87fc-0b1f0f363f96 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:34.002475 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-fde8d7a1-5ad7-490d-87fc-0b1f0f363f96 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 22 08:53:34.002877 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:34.062209 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-1c11966c-a009-4caa-8189-74fceef198c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:34.147438 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-1c11966c-a009-4caa-8189-74fceef198c9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.138676 Jun 22 08:53:34.147954 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:53:34.160103 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-1e258c55-229e-4723-9b8e-1e39ea3135fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:34.237739 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-1e258c55-229e-4723-9b8e-1e39ea3135fc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081407 Jun 22 08:53:34.238358 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 08:53:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:36.337837 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-1c11966c-a009-4caa-8189-74fceef198c9 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:36.338885 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-1c11966c-a009-4caa-8189-74fceef198c9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 22 08:53:36.339284 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:36.401852 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-44ca83bc-2cc1-4614-83be-6b3abc164a56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "swap": 0}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:36.530070 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-44ca83bc-2cc1-4614-83be-6b3abc164a56 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.184229 Jun 22 08:53:36.530647 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:53:36.543072 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-4d5267fc-c448-4e7b-932b-2be1a40a5406 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:36.709786 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-4d5267fc-c448-4e7b-932b-2be1a40a5406 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.170234 Jun 22 08:53:36.710500 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 08:53:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:53:38.829933 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-44ca83bc-2cc1-4614-83be-6b3abc164a56 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:53:38.831644 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-44ca83bc-2cc1-4614-83be-6b3abc164a56 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002772 Jun 22 08:53:38.832195 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:53:38.904166 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-2cfddbfa-500d-4a0b-820b-63d94e19876a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "vcpus": 8}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:38.977199 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-2cfddbfa-500d-4a0b-820b-63d94e19876a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.136805 Jun 22 08:53:38.977763 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Wed Jun 22 08:53:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 08:53:38.990231 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-06ec70f2-4b84-428d-8402-e75151291981 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:53:39.066347 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-06ec70f2-4b84-428d-8402-e75151291981 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079768 Jun 22 08:53:39.067468 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Wed Jun 22 08:53:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:54:04.118975 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-2cfddbfa-500d-4a0b-820b-63d94e19876a admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:04.119913 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-2cfddbfa-500d-4a0b-820b-63d94e19876a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 22 08:54:04.120310 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:04.131112 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:04.178677 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-8581730b-8f5f-4a0d-bc27-f99df0a955eb admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:04.195705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-8581730b-8f5f-4a0d-bc27-f99df0a955eb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069109 Jun 22 08:54:04.196234 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 08:54:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:54:05.111243 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-2cfddbfa-500d-4a0b-820b-63d94e19876a admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:05.112252 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-2cfddbfa-500d-4a0b-820b-63d94e19876a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001955 Jun 22 08:54:05.112644 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:05.305560 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-95769025-2c7e-4471-932e-eea7ca884fa9 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:05.311169 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.wsgi [None req-95769025-2c7e-4471-932e-eea7ca884fa9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-95769025-2c7e-4471-932e-eea7ca884fa9 admin admin] Request method failure captured: Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Accept: application/json Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Accept-Encoding: gzip, deflate Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Connection: keep-alive Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Content-Length: 0 Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Host: 10.222.0.36 Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Openstack-Api-Version: compute 2.90 Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Openstack-System-Scope: None Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: User-Agent: python-novaclient Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Auth-Token: gAAAAABistitsvy1Nq5HKin4BEHD8HEzh5Ng9qYZayAsOgnasrRuAcR4SBJV4IQdz_8ZuFp5xjidVIDlXjlLalYn8DVJahk2xIrl5bjyKSOfbjWuZ1EXBa-zLTE7Ws6M6Eug_6FXqC9Lmd7FK9PYa0QwelqCjMidbWyaC7t-GX17Q5uJQ-E0z1Y Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Domain-Id: None Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Domain-Name: None Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Identity-Status: Confirmed Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Is-Admin-Project: True Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Domain-Id: default Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Domain-Name: Default Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Name: admin Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Role: reader,member,admin Jun 22 08:54:05.314705 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Roles: reader,member,admin Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ead886d5c674d14a096a137e80b192b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}] Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant: admin Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant-Name: admin Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User: admin Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Domain-Id: default Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Domain-Name: Default Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Id: 4eee573b0bd94bdf970811c775ee4f22 Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Name: admin Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: method: > Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: exception: Flavor 42 could not be found. Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: action_args: {'id': '42'} Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:54:05.316329 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:05.317230 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.318565 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-95769025-2c7e-4471-932e-eea7ca884fa9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:54:05.319803 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-95769025-2c7e-4471-932e-eea7ca884fa9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066275 Jun 22 08:54:05.319803 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 08:54:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:05.325751 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-97bd9d75-4a24-4f45-9a25-238a0937fa57 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:05.328751 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:05.347988 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-97bd9d75-4a24-4f45-9a25-238a0937fa57 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025696 Jun 22 08:54:05.348510 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 08:54:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:54:05.358166 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-158440d1-d2d7-437e-b79b-4b52e1e82e76 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:05.381155 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-158440d1-d2d7-437e-b79b-4b52e1e82e76 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026464 Jun 22 08:54:05.381699 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 08:54:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:54:05.390879 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-38991ac4-4123-44af-bf03-15d8c4c3854e admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:05.397053 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.wsgi [None req-38991ac4-4123-44af-bf03-15d8c4c3854e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-38991ac4-4123-44af-bf03-15d8c4c3854e admin admin] Request method failure captured: Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Accept: application/json Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Accept-Encoding: gzip, deflate Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Connection: keep-alive Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Content-Length: 0 Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Host: 10.222.0.36 Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Openstack-Api-Version: compute 2.90 Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Openstack-System-Scope: None Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: User-Agent: python-novaclient Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Auth-Token: gAAAAABistitsvy1Nq5HKin4BEHD8HEzh5Ng9qYZayAsOgnasrRuAcR4SBJV4IQdz_8ZuFp5xjidVIDlXjlLalYn8DVJahk2xIrl5bjyKSOfbjWuZ1EXBa-zLTE7Ws6M6Eug_6FXqC9Lmd7FK9PYa0QwelqCjMidbWyaC7t-GX17Q5uJQ-E0z1Y Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Domain-Id: None Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Domain-Name: None Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Identity-Status: Confirmed Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Is-Admin-Project: True Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Domain-Id: default Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Domain-Name: Default Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Name: admin Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Role: reader,member,admin Jun 22 08:54:05.400333 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Roles: reader,member,admin Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ead886d5c674d14a096a137e80b192b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}] Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant: admin Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant-Name: admin Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User: admin Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Domain-Id: default Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Domain-Name: Default Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Id: 4eee573b0bd94bdf970811c775ee4f22 Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Name: admin Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: method: > Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: exception: Flavor 42 could not be found. Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: action_args: {'id': '42'} Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:54:05.401707 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:05.402554 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:05.403887 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-38991ac4-4123-44af-bf03-15d8c4c3854e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:54:05.405101 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-38991ac4-4123-44af-bf03-15d8c4c3854e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014354 Jun 22 08:54:05.405101 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 08:54:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 08:54:06.229110 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-158440d1-d2d7-437e-b79b-4b52e1e82e76 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:06.230268 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-158440d1-d2d7-437e-b79b-4b52e1e82e76 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 22 08:54:06.230667 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:06.420552 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-f69185f1-ad98-4c0b-ab1b-3b745d7752bf admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:06.428078 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.wsgi [None req-f69185f1-ad98-4c0b-ab1b-3b745d7752bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-f69185f1-ad98-4c0b-ab1b-3b745d7752bf admin admin] Request method failure captured: Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Accept: application/json Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Accept-Encoding: gzip, deflate Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Connection: keep-alive Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Content-Length: 0 Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Host: 10.222.0.36 Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Openstack-Api-Version: compute 2.90 Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Openstack-System-Scope: None Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: User-Agent: python-novaclient Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Auth-Token: gAAAAABistiuvQLHpYgxfIBGqBPmNrEnNkdVfTp_NC9M4dDEAYdqWYjc7rP_GRqbwlHwwXJ-rFLdrcxkfX4wZyyTqAkNBhSxdDdNytfS8M9HEHpPhR7_IReMeinma8leKlkA2EVQct1P8JTmi-GO6PSNMk_HqUBg1ca6rDM7z-kfo39QFzMkNmk Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Domain-Id: None Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Domain-Name: None Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Identity-Status: Confirmed Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Is-Admin-Project: True Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Domain-Id: default Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Domain-Name: Default Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Name: admin Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Role: reader,member,admin Jun 22 08:54:06.429578 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Roles: reader,member,admin Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ead886d5c674d14a096a137e80b192b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}] Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant: admin Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant-Name: admin Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User: admin Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Domain-Id: default Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Domain-Name: Default Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Id: 4eee573b0bd94bdf970811c775ee4f22 Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Name: admin Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: method: > Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: exception: Flavor 84 could not be found. Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: action_args: {'id': '84'} Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:54:06.431169 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:06.432145 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.433548 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-f69185f1-ad98-4c0b-ab1b-3b745d7752bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:54:06.434827 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-f69185f1-ad98-4c0b-ab1b-3b745d7752bf admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063031 Jun 22 08:54:06.434827 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 08:54:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:06.440826 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-8e73590c-9dd5-45d3-9d9f-4f5680bba7e3 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:06.454735 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-8e73590c-9dd5-45d3-9d9f-4f5680bba7e3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017151 Jun 22 08:54:06.455275 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 08:54:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:54:06.464978 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-02914b4a-b51f-4316-a4a6-7610726c1a9f admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:06.479619 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-02914b4a-b51f-4316-a4a6-7610726c1a9f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018515 Jun 22 08:54:06.480150 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 08:54:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:54:06.489448 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-53d4125d-859f-441b-867b-2162d84fbba2 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:06.494745 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.wsgi [None req-53d4125d-859f-441b-867b-2162d84fbba2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-53d4125d-859f-441b-867b-2162d84fbba2 admin admin] Request method failure captured: Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Accept: application/json Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Accept-Encoding: gzip, deflate Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Connection: keep-alive Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Content-Length: 0 Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Host: 10.222.0.36 Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Openstack-Api-Version: compute 2.90 Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Openstack-System-Scope: None Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: User-Agent: python-novaclient Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Auth-Token: gAAAAABistiuvQLHpYgxfIBGqBPmNrEnNkdVfTp_NC9M4dDEAYdqWYjc7rP_GRqbwlHwwXJ-rFLdrcxkfX4wZyyTqAkNBhSxdDdNytfS8M9HEHpPhR7_IReMeinma8leKlkA2EVQct1P8JTmi-GO6PSNMk_HqUBg1ca6rDM7z-kfo39QFzMkNmk Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Domain-Id: None Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Domain-Name: None Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Identity-Status: Confirmed Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Is-Admin-Project: True Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Domain-Id: default Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Domain-Name: Default Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Name: admin Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Role: reader,member,admin Jun 22 08:54:06.496225 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Roles: reader,member,admin Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ead886d5c674d14a096a137e80b192b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}] Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant: admin Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant-Name: admin Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User: admin Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Domain-Id: default Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Domain-Name: Default Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Id: 4eee573b0bd94bdf970811c775ee4f22 Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Name: admin Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: method: > Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: exception: Flavor 84 could not be found. Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: action_args: {'id': '84'} Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:54:06.497799 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:06.499030 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:06.500350 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-53d4125d-859f-441b-867b-2162d84fbba2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:54:06.501762 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-53d4125d-859f-441b-867b-2162d84fbba2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011791 Jun 22 08:54:06.501762 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Jun 22 08:54:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:07.320407 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-02914b4a-b51f-4316-a4a6-7610726c1a9f admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:07.321431 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-02914b4a-b51f-4316-a4a6-7610726c1a9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 22 08:54:07.321821 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:07.511086 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-261bcc8c-cfae-46c7-86de-ce181190e56a admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:07.517458 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.wsgi [None req-261bcc8c-cfae-46c7-86de-ce181190e56a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-261bcc8c-cfae-46c7-86de-ce181190e56a admin admin] Request method failure captured: Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Accept: application/json Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Accept-Encoding: gzip, deflate Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Connection: keep-alive Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Content-Length: 0 Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Host: 10.222.0.36 Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Openstack-Api-Version: compute 2.90 Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Openstack-System-Scope: None Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: User-Agent: python-novaclient Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Auth-Token: gAAAAABistiv72HcdlCrjFVh8s3PM-tbrc3sMBEP6Vaiu46e0gDDFBFzkibqpahJZRL3_9zDAWuGklgVCeWnS7nBzrq5FwyT8rMWU7ucHm3q0jrFIn_TZYkOJSMS-9cxLyogOMPNWmiUM7POPxKsGAaq8s3L9ThQdjSpnkw3LxKDI3hpRIgEXNU Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Domain-Id: None Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Domain-Name: None Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Identity-Status: Confirmed Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Is-Admin-Project: True Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Domain-Id: default Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Domain-Name: Default Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Project-Name: admin Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Role: reader,member,admin Jun 22 08:54:07.518976 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Roles: reader,member,admin Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ead886d5c674d14a096a137e80b192b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}] Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant: admin Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-Tenant-Name: admin Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User: admin Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Domain-Id: default Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Domain-Name: Default Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Id: 4eee573b0bd94bdf970811c775ee4f22 Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: X-User-Name: admin Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: method: > Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: exception: Flavor 451 could not be found. Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: action_args: {'id': '451'} Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:54:07.520503 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:07.521352 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.522442 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-261bcc8c-cfae-46c7-86de-ce181190e56a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:54:07.523429 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-261bcc8c-cfae-46c7-86de-ce181190e56a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060401 Jun 22 08:54:07.523429 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 08:54:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:07.529882 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-0b4e1edf-a936-4098-a905-d75ac2ee0eab admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:07.543445 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-0b4e1edf-a936-4098-a905-d75ac2ee0eab admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017116 Jun 22 08:54:07.548044 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 08:54:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:54:07.556473 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:07.570731 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017829 Jun 22 08:54:07.571253 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Jun 22 08:54:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 08:54:07.585182 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-5db2f361-bbea-4c4d-a12a-b960a0506e22 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:07.590616 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.wsgi [None req-5db2f361-bbea-4c4d-a12a-b960a0506e22 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-5db2f361-bbea-4c4d-a12a-b960a0506e22 admin admin] Request method failure captured: Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Accept: application/json Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Accept-Encoding: gzip, deflate Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Connection: keep-alive Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Content-Length: 0 Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Host: 10.222.0.36 Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Openstack-Api-Version: compute 2.90 Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Openstack-System-Scope: None Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: User-Agent: python-novaclient Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Auth-Token: gAAAAABistiv72HcdlCrjFVh8s3PM-tbrc3sMBEP6Vaiu46e0gDDFBFzkibqpahJZRL3_9zDAWuGklgVCeWnS7nBzrq5FwyT8rMWU7ucHm3q0jrFIn_TZYkOJSMS-9cxLyogOMPNWmiUM7POPxKsGAaq8s3L9ThQdjSpnkw3LxKDI3hpRIgEXNU Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Domain-Id: None Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Domain-Name: None Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Identity-Status: Confirmed Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Is-Admin-Project: True Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Domain-Id: default Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Domain-Name: Default Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Project-Name: admin Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Role: reader,member,admin Jun 22 08:54:07.592098 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Roles: reader,member,admin Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ead886d5c674d14a096a137e80b192b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ead886d5c674d14a096a137e80b192b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ead886d5c674d14a096a137e80b192b"}]}] Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant: admin Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant-Id: 4ead886d5c674d14a096a137e80b192b Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-Tenant-Name: admin Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User: admin Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Domain-Id: default Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Domain-Name: Default Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Id: 4eee573b0bd94bdf970811c775ee4f22 Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: X-User-Name: admin Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: method: > Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: exception: Flavor 451 could not be found. Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: action_args: {'id': '451'} Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 08:54:07.593629 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:07.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: ERROR nova.api.openstack.wsgi Jun 22 08:54:07.596121 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-5db2f361-bbea-4c4d-a12a-b960a0506e22 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 08:54:07.597154 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-5db2f361-bbea-4c4d-a12a-b960a0506e22 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011903 Jun 22 08:54:07.597154 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 08:54:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:08.410444 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:08.411448 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 22 08:54:08.411838 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:08.603850 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-fdf0b7e6-7b62-4675-a76d-ecaa07852b86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:54:08.683181 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-fdf0b7e6-7b62-4675-a76d-ecaa07852b86 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.132432 Jun 22 08:54:08.683730 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 08:54:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:54:09.501425 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:09.502460 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 22 08:54:09.502856 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:09.695601 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-7e2a4407-a3ac-445d-8939-dc902a3e1c2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:54:09.791881 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-7e2a4407-a3ac-445d-8939-dc902a3e1c2f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.146791 Jun 22 08:54:09.792431 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 08:54:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:54:10.608509 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:10.609497 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Jun 22 08:54:10.609914 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:10.801085 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-ccaf13bb-8bfb-476d-a484-23dc2b5a170b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:54:10.889198 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-ccaf13bb-8bfb-476d-a484-23dc2b5a170b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.139078 Jun 22 08:54:10.889740 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 08:54:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:54:11.704754 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:11.705751 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Jun 22 08:54:11.706179 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:11.896362 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-f7efb0a3-2470-4ca6-a401-822f45e5f9f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 08:54:11.978941 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-f7efb0a3-2470-4ca6-a401-822f45e5f9f6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.134337 Jun 22 08:54:11.979480 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Jun 22 08:54:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:54:12.816943 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:12.817927 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jun 22 08:54:12.818360 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:13.005946 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-74cf5819-736e-4a68-82cc-dc065ebfba85 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:13.024899 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-74cf5819-736e-4a68-82cc-dc065ebfba85 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070779 Jun 22 08:54:13.025426 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Jun 22 08:54:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:54:59.812168 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:59.813163 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-9d2bdbb0-d1e8-47f5-975b-a5ef1a6a44d4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 22 08:54:59.813547 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Wed Jun 22 08:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:54:59.823633 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:59.873010 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-3602ed96-41bd-45b2-bbd8-68d09a76bd3e admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:59.892871 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-3602ed96-41bd-45b2-bbd8-68d09a76bd3e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073603 Jun 22 08:54:59.893410 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Wed Jun 22 08:54:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:54:59.916837 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-03aa3e6c-8f60-4786-a6b1-f0c4e55d82fb admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:59.920251 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG dbcounter [-] [103497] Writing DB stats nova_api:SELECT=14 {{(pid=103497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:59.925359 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-03aa3e6c-8f60-4786-a6b1-f0c4e55d82fb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012089 Jun 22 08:54:59.925935 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Jun 22 08:54:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:54:59.937586 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-9c26e651-369e-4b81-8e33-24834f089f8c admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:59.945384 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-9c26e651-369e-4b81-8e33-24834f089f8c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011866 Jun 22 08:54:59.945906 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Jun 22 08:54:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:54:59.958331 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:59.966303 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011838 Jun 22 08:54:59.966817 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Wed Jun 22 08:54:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:54:59.978076 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-e1ac4268-101c-4477-bb5f-45142dd7f295 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:54:59.985594 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-e1ac4268-101c-4477-bb5f-45142dd7f295 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011037 Jun 22 08:54:59.986120 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Wed Jun 22 08:54:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 08:58:27.574760 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:27.575901 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Jun 22 08:58:27.576654 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:27.724877 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_api:SELECT=6 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:27.847448 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-a4f59401-1945-4d06-a615-f21fa265c8e8 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:27.851949 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:58:27.851949 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: warnings.warn(msg) Jun 22 08:58:27.851949 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-a4f59401-1945-4d06-a615-f21fa265c8e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:27.851949 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-a4f59401-1945-4d06-a615-f21fa265c8e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:27.851949 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-a4f59401-1945-4d06-a615-f21fa265c8e8 admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:27.851949 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-a4f59401-1945-4d06-a615-f21fa265c8e8 admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:27.887298 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-a4f59401-1945-4d06-a615-f21fa265c8e8 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.163799 Jun 22 08:58:27.887881 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 08:58:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:58:28.754706 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:28.755716 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 22 08:58:28.756112 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:58:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:28.950187 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-8e3e4ae0-6507-43df-b3b0-c60c12e10b35 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:28.951458 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:58:28.951458 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: warnings.warn(msg) Jun 22 08:58:28.952656 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ae0-6507-43df-b3b0-c60c12e10b35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:28.953102 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ae0-6507-43df-b3b0-c60c12e10b35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:28.953912 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ae0-6507-43df-b3b0-c60c12e10b35 admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:28.954391 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-8e3e4ae0-6507-43df-b3b0-c60c12e10b35 admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:28.974352 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-8e3e4ae0-6507-43df-b3b0-c60c12e10b35 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076989 Jun 22 08:58:28.974920 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 08:58:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 08:58:40.248667 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:40.249713 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 22 08:58:40.250130 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 08:58:40.394287 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_cell0:SELECT=4 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:40.395015 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_cell1:SELECT=4 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:40.395622 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG dbcounter [-] [103498] Writing DB stats nova_api:SELECT=8 {{(pid=103498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:40.444078 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-15bf42f8-0388-4d89-8987-bdfc6c48d7fd admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:40.445232 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:58:40.445232 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: warnings.warn(msg) Jun 22 08:58:40.446484 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-15bf42f8-0388-4d89-8987-bdfc6c48d7fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.446929 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-15bf42f8-0388-4d89-8987-bdfc6c48d7fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.447713 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-15bf42f8-0388-4d89-8987-bdfc6c48d7fd admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:40.448274 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-15bf42f8-0388-4d89-8987-bdfc6c48d7fd admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:40.474358 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-15bf42f8-0388-4d89-8987-bdfc6c48d7fd admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084278 Jun 22 08:58:40.474835 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 08:58:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:58:41.305751 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: DEBUG nova.api.openstack.wsgi [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] Calling method '>' {{(pid=103497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:41.306785 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: INFO nova.api.openstack.requestlog [None req-3c2cf387-c87f-461d-a88d-f2235cd54370 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 22 08:58:41.307191 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: [pid: 103497|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Jun 22 08:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 08:58:41.500167 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG nova.api.openstack.wsgi [None req-b8093f51-a013-40f9-ae8c-19ffd1f63971 admin admin] Calling method '>' {{(pid=103498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 08:58:41.501356 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:58:41.501356 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: warnings.warn(msg) Jun 22 08:58:41.502663 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-b8093f51-a013-40f9-ae8c-19ffd1f63971 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:41.503140 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-b8093f51-a013-40f9-ae8c-19ffd1f63971 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:41.503946 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-b8093f51-a013-40f9-ae8c-19ffd1f63971 admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:58:41.504379 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: DEBUG oslo_concurrency.lockutils [None req-b8093f51-a013-40f9-ae8c-19ffd1f63971 admin admin] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:58:41.528541 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: INFO nova.api.openstack.requestlog [None req-b8093f51-a013-40f9-ae8c-19ffd1f63971 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081069 Jun 22 08:58:41.529268 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: [pid: 103498|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Jun 22 08:58:41 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 08:59:38.386505 dv-cinder-787296-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 08:59:38.387939 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: Wed Jun 22 08:59:38 2022 - graceful shutdown triggered... Jun 22 08:59:38.388694 dv-cinder-787296-11-iscsi devstack@n-api.service[103497]: Gracefully killing worker 1 (pid: 103497)... Jun 22 08:59:38.389412 dv-cinder-787296-11-iscsi devstack@n-api.service[103498]: Gracefully killing worker 2 (pid: 103498)... Jun 22 08:59:39.389112 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: worker 1 buried after 1 seconds Jun 22 08:59:39.389112 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: worker 2 buried after 1 seconds Jun 22 08:59:39.389773 dv-cinder-787296-11-iscsi devstack@n-api.service[103496]: goodbye to uWSGI. Jun 22 08:59:39.390759 dv-cinder-787296-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 08:59:39.391339 dv-cinder-787296-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 08:59:39.394153 dv-cinder-787296-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 08:59:39.403672 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:59:39 2022] *** Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: nodename: dv-cinder-787296-11-iscsi Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: machine: x86_64 Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: clock source: unix Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: pcre jit disabled Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: detected number of CPU cores: 4 Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: current working directory: / Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: your processes number limit is 47680 Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: your memory page size is 4096 bytes Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: detected max file descriptor number: 2048 Jun 22 08:59:39.405668 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: lock engine: pthread robust mutexes Jun 22 08:59:39.406641 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: thunder lock: enabled Jun 22 08:59:39.406641 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 08:59:39.406641 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:59:39.451560 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: Python main interpreter initialized at 0x563c6ab679c0 Jun 22 08:59:39.451560 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: python threads support enabled Jun 22 08:59:39.451560 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: your server socket listen backlog is limited to 100 connections Jun 22 08:59:39.451560 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:59:39.452025 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:59:39.452025 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: *** Operational MODE: preforking *** Jun 22 08:59:39.452278 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:59:39.452278 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: spawned uWSGI master process (pid: 118014) Jun 22 08:59:39.452495 dv-cinder-787296-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 08:59:39.453394 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: spawned uWSGI worker 1 (pid: 118028, cores: 1) Jun 22 08:59:39.453514 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: spawned uWSGI worker 2 (pid: 118029, cores: 1) Jun 22 08:59:39.453658 dv-cinder-787296-11-iscsi devstack@n-api.service[118014]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:59:40.147189 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:59:40.159556 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 08:59:41.421848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:59:41.421848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: from cryptography.utils import int_from_bytes Jun 22 08:59:41.423014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:59:41.423014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: from cryptography.utils import int_from_bytes Jun 22 08:59:41.491315 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:59:41.491315 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: from cryptography.utils import int_from_bytes Jun 22 08:59:41.492010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:59:41.492010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: from cryptography.utils import int_from_bytes Jun 22 08:59:44.213152 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:59:44.213727 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:59:44.214224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:59:44.214596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:59:44.214858 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:59:44.215255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.215594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.215919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.216244 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.216579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.216893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.217222 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.217548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.217883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.218168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.218488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.218819 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-11-iscsi {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.219146 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.219459 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.219772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.220102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.220414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.220740 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.221064 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.221574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.223658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.223658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.223658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.223658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.223658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.224414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.224414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.224723 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.224867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.225311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.225745 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-11-iscsi {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.226202 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.226748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.226748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.227482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.227482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.229339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.229339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.229339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.230529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.230529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.230529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.231568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.231568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.231568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.232461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.232461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.232461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.233169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.233169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.233169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.233909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.233909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.234415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.234646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.235000 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.235000 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.235460 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.235700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.235943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.236211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.236458 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.238361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.238361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.238361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.238361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.238361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.239516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.239516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.239516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.240184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.240184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.240645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.240645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.241125 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.241373 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.241615 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.241913 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.242263 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.242593 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.242909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.243224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.243562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.243895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.244507 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.244990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.245254 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.245567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.245883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.246237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.246555 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.247791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.247791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.247791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.248871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.248871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.248871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.248871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.249795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.249795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.249795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.250665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.250665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.250665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.251327 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.251327 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.251788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.251788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.252215 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.252594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.252916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.253231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.253562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.253876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.254214 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.254541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.254855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.255297 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.255635 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.255965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.256281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.256606 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.256919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.258240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.258240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.258240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.258240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.259504 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.259504 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.259504 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.259504 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.260428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.260428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.260903 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.261132 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.261378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.261687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.262235 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.262578 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.262931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.263251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.263590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.263926 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.264252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.264569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.264888 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.265217 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.265557 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.265874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.266210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.266527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.266853 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.267200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.268438 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.268438 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.268438 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.269528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.269528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.269528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.269528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.270501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.270501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.270997 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.271231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.271459 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.271690 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.271985 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.272303 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.272620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.272949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.273288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.273608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.273931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.274271 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.274591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.275505 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.276053 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.276577 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.276948 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.277277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.278862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.278862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.278862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.278862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.278862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.280440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.280440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.280440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.280440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.280440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.281817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.281817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.281817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.281817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.282766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.282766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.282766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.283390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.283390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.284251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.284251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.284251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.284890 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.284890 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.285320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.285320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.285779 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.286259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.286512 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.286715 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.286991 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.287305 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.287623 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.288394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.288394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.289390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.289390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.289390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.290141 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.290566 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.291181 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.292039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.292503 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.293035 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.293595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.294161 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.294722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.295288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.295845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.296447 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.297619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.297619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.299069 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.299069 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.300673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.300673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.300673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.301200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.301200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.301693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.302236 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.302887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.303525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.304119 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.304693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.305149 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.305707 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.307354 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.307898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.308397 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.308963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.309379 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.310249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.310692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.311126 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.311616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.311997 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.312410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.312741 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.313124 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.313490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.313844 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.314457 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.314646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.314860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.315309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.315660 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.316014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.317525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.317525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.317810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.318543 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.319105 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.319499 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.319761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.320175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.320818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.321330 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.322667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.323147 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.323786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.324372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.324970 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.325549 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.326105 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.326617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.326972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.327325 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.327657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.327988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.328323 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.328717 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.329291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.329874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.330579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.331104 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.331685 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.332376 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.332845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.333197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.333670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.334294 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.334883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.335478 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.335906 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.336520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.337076 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.337450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.337923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.338453 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:59:44.339675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.340140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:59:44.340379 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.340589 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:59:44.341008 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.341603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:59:44.341603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:59:44.342020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.342020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.342488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.342710 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.342913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.343135 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.343287 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.343449 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.343603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.343896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.344064 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.344206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.344356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.344496 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.344637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.344775 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.344921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.345068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.345218 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.345358 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.345594 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.345920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.346145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.346339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.346339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.346803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-11-iscsi {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.347043 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.347282 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.347282 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.347720 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.347720 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.348566 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.348806 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.349049 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.349281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.349281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.350443 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.350742 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.350971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.351292 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.351633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.352052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.352052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.352513 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.352830 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.353645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.353928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.354457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.354705 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.354936 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.355175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.355356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.355524 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.355524 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.355880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.357792 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.357792 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.358151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.358307 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.358473 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.358624 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.358780 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.358921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.359069 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.359210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.359210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.359513 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.359796 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.359796 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.360411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-11-iscsi {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.360570 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.360570 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.360871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.361021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.361021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.361321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.361590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.361590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.362016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.362192 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.362192 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.362478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.362627 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.363170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.363324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.363481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.363628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.363774 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.363921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.364085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.364251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.364554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.364709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.364856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.364856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.365140 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.365295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.365451 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.365623 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.365623 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.365917 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.366104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.366104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.366495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.366652 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.366807 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.366967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.366967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.366967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.367399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.367557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.367710 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.367865 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.368018 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.368173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.368319 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.369394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.369394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.369394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.369975 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.370365 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.370641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.370815 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.370981 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.371148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.371303 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.371450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.371718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.371902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.372176 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.372328 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.372474 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.372628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.372774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.372774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.373075 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.373370 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.373524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.373677 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.373677 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.373972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.374182 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.374182 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.374493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.374746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.374746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.375052 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.375813 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.375982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.376144 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.376144 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.376554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.376709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.376709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.377006 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.377441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.377441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.377441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.377928 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.378095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.378263 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.378412 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.378412 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.378689 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.378834 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.378834 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.379133 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.379282 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.379427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.379581 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.379581 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.379880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.380160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.380160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.380819 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.380988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.381149 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.381306 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.381306 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.381585 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.382028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.382028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.382598 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.382754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.382754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.383062 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.383216 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.383216 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.383664 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.383831 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.383831 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.384174 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.384339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.384339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.384630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.385250 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.385408 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.385568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.385568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.385861 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.386023 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.386209 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.386356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.386502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.386776 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.386776 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.387083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.387229 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.387375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.387538 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.387538 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.387832 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.387986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.387986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.388281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.388427 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.388581 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.388742 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.388742 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.389021 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.389186 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.389186 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.389486 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.389645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.389645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.389943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.390111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.390418 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.390804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.390804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.391306 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.391453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.391453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.391754 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.392251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.392446 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.392731 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.392884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.393030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.393030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.393304 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.393632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.393632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.393951 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.394339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.394439 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.394563 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.394563 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.394782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.394855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.394931 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.395033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.395033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.395197 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.395289 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.395491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.395678 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.395803 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.396020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.396147 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.396470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.396584 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.396785 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.397094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.397218 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.397450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.397685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.397791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.398090 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.398309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.398403 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.398718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.398826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.399032 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.399337 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.399481 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.399837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.400013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.400177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.400351 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.400739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.400846 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.401235 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.401344 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.401564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.401719 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.401892 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.402033 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.402227 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.402377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.402533 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.402670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.402984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.403163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.403316 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.403480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.403632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.403775 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.403919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.404080 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.404228 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.404388 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.404541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.404687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.404823 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.404967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.405111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.405258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.405393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.405542 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.405678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.405824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.405961 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.406155 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.406334 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.406621 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:59:44.406761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.407065 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.407233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.407385 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.407524 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.407799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.407948 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.408109 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.408497 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.408645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.408845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.409104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.409249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.409482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.409709 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.409844 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.410145 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.410340 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.410460 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.410783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.410913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.411184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.411419 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.411529 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.411747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.412064 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.412154 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.412392 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.412633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.412782 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.413029 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.413178 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.413949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.413949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.414295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.414421 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.414547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.414799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.414799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.415048 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.415175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.415972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.416422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.416560 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.416781 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.416946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.417224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.417371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.418278 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.418278 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.418608 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.418765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.418765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.419055 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.419198 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.419347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.419495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.419495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.419777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.419931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.420074 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.420315 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.420472 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.420794 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.420998 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.421357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.421357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.421770 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.421913 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.422099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.422263 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.422425 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.422906 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.423502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.423922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.424094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.424278 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.424636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.425491 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.425652 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.425805 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.425954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.425954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.426404 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.426734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.426734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.427015 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.427165 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.427165 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.427559 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.427701 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.427856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.428021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.428021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.428328 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.428557 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.428711 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.428865 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.429168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.429320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.429478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.429715 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.429880 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.429971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.430225 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.430535 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.430626 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.430937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.431163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.432118 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.432283 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.432594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.432884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.433084 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.433318 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.433472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.433626 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.433965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.434145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.434306 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.434633 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.434806 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.434994 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.435220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.435474 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.435795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.435947 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.436092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.436377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.436550 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.436759 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.436929 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.437095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.437421 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.437593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.437747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.438044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.438161 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.438416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.438657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.438751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.439062 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.439226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.439389 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.439718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.439880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.440028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.440354 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.440521 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.440777 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.440959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.441209 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.441411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.441602 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.441729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.442076 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.442235 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.442429 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.442725 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.442971 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.443302 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.443439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.443650 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.443888 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.444026 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.444247 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.444460 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.444554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.447266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.447414 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.447528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.447528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.447755 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.447949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.447949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.448227 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.448340 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.448493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.448659 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.448815 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.448979 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.449143 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.449309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.449309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.449596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.449759 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.449759 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.450173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.450356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.450509 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.450662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.450662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.450959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.451134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.451134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.451963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.452313 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.452313 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.452689 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.452897 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.452897 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.453306 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.453588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.453588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.453971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.454292 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.454292 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.454602 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.454758 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.454926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.455097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.455097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.455394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.455561 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.455561 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.455906 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.456138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.456138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.456432 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.456644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.456803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.456975 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.456975 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.457256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.457419 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.457419 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.457727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.457897 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.458110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.458266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.458266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.458562 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.458714 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.458714 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.459198 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.459366 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.459530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.459682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.459682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.459975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.460130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.460294 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.460443 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.460605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.460818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.460982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.461147 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.461454 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.461614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.465607 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.465750 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.465845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.465920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466005 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466095 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466185 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466269 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466403 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466403 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466632 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466714 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466786 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.466921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467092 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467330 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467404 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467404 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467544 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467875 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.467875 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.468026 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.468105 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.468465 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.468588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.468678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.468990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.469100 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.469359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.469597 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.469759 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.469989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.470225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.470360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.470692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.470845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.471262 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.471416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.471821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.471970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.472396 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.472518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.472959 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.473099 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.473538 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.473685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.474174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.474336 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.474726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.474907 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.475612 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.475812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.476009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.476184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.476346 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.476491 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.476819 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.477052 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.477343 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.477641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.477851 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.478760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.478949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.479346 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.479523 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.479997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.480154 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.480620 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.480791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.481228 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.481405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.481804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.482052 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.482356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.482520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.483022 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.483261 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.483593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.483875 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.484192 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.484482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.484787 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.485122 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.485382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.485749 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.485987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.486349 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.486718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.486930 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.487200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.487494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.488050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.488372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.488656 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.488928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.489248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.489493 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.489855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.490014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.490461 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.490609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.491061 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.491219 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.491680 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.491861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.492100 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.492301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.492709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.492872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.493283 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.493456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.494576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.494744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.495047 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.495310 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.495656 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.495821 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.496245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.496492 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.496652 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.496918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.497079 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.497317 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.497499 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.497676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.497990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.498204 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.498360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.498674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.498836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.499120 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.499329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.499711 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.499867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.500308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.500488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.500894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.501070 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.501457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.501683 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.504821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.505074 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.505302 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.505516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.505516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.505895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.505895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.506331 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.506331 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.506774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.507003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.507215 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.507443 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.507443 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.507814 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.508014 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.508224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.508224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.508224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.508852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.509056 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.509279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.509499 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.509670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.509921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.510111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.510597 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.510811 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.511202 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.511392 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.511825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.511990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.512409 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.512582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.513002 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.513198 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.513590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.513771 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.514106 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.514239 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.514453 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.514786 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.514963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.515134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.515371 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.515495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.515759 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.515939 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.516101 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.516276 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.516441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.516709 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.516864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.517012 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.517339 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.517576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.517788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.518008 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.518236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.518397 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.518570 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.518804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.518969 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.518969 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.519255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.519406 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.519640 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.519856 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.520007 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.520170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.520326 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.520492 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.520889 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.520889 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.521200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.521367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.521587 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.521810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.522201 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.522414 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.522540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.522673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.522824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.523113 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.523267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.523523 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.523871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.524052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.524334 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.524521 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.525000 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.525183 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.525618 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.525783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.526096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.526366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.526791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.526969 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.527427 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.527523 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.527788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.528078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.528330 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.528572 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.528812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.528967 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.529142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.529288 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.529620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.529851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.530107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.530338 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.530485 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.530615 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.530861 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.531075 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.531311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.531543 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.531757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.531969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.532162 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.532287 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.532690 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.532900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.533115 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.533294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.533530 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.533741 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.533952 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.534191 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.534361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.534509 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.534667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.534772 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.534988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.535082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.535384 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.535491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.535664 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.535922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.536096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.536223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.536346 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.536481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.536628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.536768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.536930 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.537134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.537291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.537576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.537744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.537947 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.538259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.538463 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.538616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.538801 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.538960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.539175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.539278 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.539552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.539683 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.539875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.540077 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.540225 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.540875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.541032 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.541166 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.541367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:59:44.541573 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.541767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.542109 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.542535 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.542923 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.543288 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.543615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.543923 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.544242 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.544554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.544882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.545262 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.545727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.546044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.546396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.546718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.547054 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.547401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.547716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.548252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.548772 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.549296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.549792 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.550354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.550897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.551411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.551971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.552484 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.553012 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.553395 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.553726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.554047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.554391 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.554718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.555055 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.555382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.555697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.556881 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.557067 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.557246 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.557556 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.557874 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.558309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.558522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.558830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.559142 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.559455 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.559787 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.560105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.560427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.560714 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.561021 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.561367 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.561683 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.562091 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.562386 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.562709 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.563033 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.563557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.563947 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.564476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.565044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.565587 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.565916 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.566285 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.566604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.567077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.567258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.567563 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.567924 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.568219 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.568550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.568882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.569192 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.569509 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.569835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.570175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.570495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.570811 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.571131 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.571448 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.572298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.572620 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.572936 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.573295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.573696 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.574030 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.574367 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.574700 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.575047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.575597 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.576169 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.576712 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.577254 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.577743 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.578527 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.579112 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.579699 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.580258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.580752 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.581345 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.581969 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.582575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.583150 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.583876 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.584461 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.585042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.585623 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.586179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.586662 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.587202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.588361 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.588891 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.589462 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.590026 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.590658 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.591165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.591512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.592103 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.592276 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.592619 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.593253 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.593710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.594208 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.594630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.595176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.595764 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.596341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.596902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.597492 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.598142 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.598648 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.599245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.599849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.600420 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.600973 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.601516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.602084 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.602651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.603968 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.604486 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.605087 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.605600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.605980 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.606339 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.606765 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.607085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.607434 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.608852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.608852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.608852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.608852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.609203 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.609287 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.609635 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.609894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.610252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.610644 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.611054 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.611265 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.611647 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.611939 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.612233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.612564 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.613375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.613517 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.613829 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.614210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.614709 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.614951 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.615176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.615443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO dbcounter [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Registered counter for database nova_api Jun 22 08:59:44.615689 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.615859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.616135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.616480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.617025 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.617497 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.618025 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.618710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.619266 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.619825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.620396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.620951 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.621528 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.622139 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.623201 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.623773 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.624353 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.624764 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.625129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.625446 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.625784 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.626134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.626453 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.626773 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.627085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.627436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.627749 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.628091 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.628414 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.628742 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.629078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.629394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.629943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.630226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.630457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.630694 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.631015 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.631464 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.631656 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.633430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.633430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.633430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.633430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.633430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.634469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.635202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.635667 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.636248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.636741 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.637305 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.637876 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.638473 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.638928 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.639456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.640084 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.640531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.640876 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.641224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.641591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_db.sqlalchemy.engines [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:44.641733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.641907 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.642266 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.642590 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.642917 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.643292 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.643650 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.644195 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.644669 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.645260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.645645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.645859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.646331 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.646871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.647455 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.648052 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.648568 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.649160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.649667 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.650358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.650563 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writer thread running {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:44.651056 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.651680 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.652306 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.652862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.653432 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.654233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.654755 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.655205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.655655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.656177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.656514 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.657033 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.657629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.658192 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.658707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.659229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.659717 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.660148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.660633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.661134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.661615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.662263 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.662866 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.663826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.664450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.665043 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.666094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.666504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.666862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.667249 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.667506 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.667826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.668145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.668472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.668785 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.669104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.669415 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.669735 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.670161 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.670485 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.670925 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.671364 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.671766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.672224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.672605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.673197 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.673611 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.674027 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.674475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.674887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.675299 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.675727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.676137 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.676554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.676965 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.677469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.677887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.678349 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.678803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.679243 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.679729 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.680284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.680675 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.681699 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.682237 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.682676 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.683116 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.683589 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.683978 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.684665 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.685071 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.685456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.685867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.686316 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.686697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.687074 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.687523 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.688071 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.688506 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.688978 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.689440 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.689910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.690415 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.690845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.691303 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.691694 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.692151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.692611 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.693077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.693613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.694210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.694614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.695076 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.695505 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.695937 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.696360 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.696820 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.697305 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.697858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.698217 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.698675 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.699175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.699625 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.700078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.700529 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.701165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.701624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.702019 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.702499 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.702932 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.703335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.703920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.704335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.704770 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.705196 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.705631 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.706147 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.706682 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.707144 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.707567 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.707979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.708397 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.708858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.709290 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.709707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.710173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.710583 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.711009 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.711453 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.711907 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.712800 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.713311 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.713695 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.714234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.714632 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.715436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.715436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.715952 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.716264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.716646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.717022 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.717396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.717769 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.718183 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.718558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.718971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.719445 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.719898 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.720371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.720824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.721280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.721820 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.722294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.722697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.723170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.723619 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.724082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.724549 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.724994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.725442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.725707 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.context [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94958f18-576d-4472-bcc3-5e5788834e8e(cell1) {{(pid=118028) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:59:44.725993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.726453 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.726875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.727455 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.728785 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.729226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.729788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.730384 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.730960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.731227 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:44.731510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.732054 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.732618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.732856 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:44.733167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.734366 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:44.734487 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.734487 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.734872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.735450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.735973 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:44.736142 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.736591 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.738081 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.738081 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.738583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO dbcounter [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Registered counter for database nova_cell0 Jun 22 08:59:44.738697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.739286 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.739895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.740536 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.741128 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.741752 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.742400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.743684 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO dbcounter [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Registered counter for database nova_cell1 Jun 22 08:59:44.744580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.744580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.744580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:59:44.744580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:59:44.751590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_db.sqlalchemy.engines [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:44.757126 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writer thread running {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:44.757789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_db.sqlalchemy.engines [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:44.930794 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writer thread running {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:44.936168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO dbcounter [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Registered counter for database nova_api Jun 22 08:59:44.942386 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO dbcounter [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Registered counter for database nova_cell0 Jun 22 08:59:44.956663 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_db.sqlalchemy.engines [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:44.962753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_db.sqlalchemy.engines [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:44.965573 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writer thread running {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:44.973983 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writer thread running {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:45.053821 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.context [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94958f18-576d-4472-bcc3-5e5788834e8e(cell1) {{(pid=118029) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 08:59:45.059528 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.061568 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.063069 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 08:59:45.067228 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 08:59:45.071467 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO dbcounter [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Registered counter for database nova_cell0 Jun 22 08:59:45.080427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO dbcounter [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Registered counter for database nova_cell1 Jun 22 08:59:45.092970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_db.sqlalchemy.engines [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:45.100530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writer thread running {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:45.293967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_db.sqlalchemy.engines [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:45.300499 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writer thread running {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:45.313827 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO dbcounter [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Registered counter for database nova_cell0 Jun 22 08:59:45.322719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: WARNING keystonemiddleware.auth_token [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:59:45.324185 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_db.sqlalchemy.engines [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:59:45.328782 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: WARNING keystonemiddleware.auth_token [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:59:45.337241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writer thread running {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:59:45.762341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: WARNING keystonemiddleware.auth_token [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:59:45.772144 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: WARNING keystonemiddleware.auth_token [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:59:45.772691 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: WARNING keystonemiddleware.auth_token [None req-f9e5c11a-f2c3-4c7e-a7ac-63625f62c68e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:59:45.780768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: WARNING keystonemiddleware.auth_token [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:59:45.781941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c6ab679c0 pid: 118028 (default app) Jun 22 08:59:46.153023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: WARNING keystonemiddleware.auth_token [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 08:59:46.159125 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: WARNING keystonemiddleware.auth_token [None req-01846d65-5df3-4c9a-af27-4c2d3bb6c59d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 08:59:46.164689 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563c6ab679c0 pid: 118029 (default app) Jun 22 09:00:31.486655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=3 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:31.488523 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=3 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:31.489549 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=3 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:31.490365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=3 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:32.285143 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:32.286631 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:32.287884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:32.289836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:33.307485 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e444ef0f-8d2d-4863-8c7b-3b1a024d5184 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Action: 'create', calling method: .version_select at 0x7fb333fa3790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1368243944", "metadata": {"Type": "work"}}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:34.073729 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cb448a25-5e1b-414a-8263-d0cb82d4802b tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Action: 'create', calling method: .version_select at 0x7fb333f5a5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1028116444", "metadata": {"Type": "work"}}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cb448a25-5e1b-414a-8263-d0cb82d4802b tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Request method failure captured: Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 122 Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistowv7hNnru5-R-8tcXe6QWL8iIaPo8wqR3YUu-Pj3xoTqvGetmZ2xW_Oqw1JEyIWVa_a6-4bZPLwDDI5lfjqz3NxcNKy-2ogKM2DfYs3Kil6ldpnc-34tjpWgU2xrPG5tR9R1t6eDJFT2NQ6OmsyQo1TqlYp3_t3V-dUX20HgTLIrU Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:00:34.092766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}] Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: d9bd65bd93b645a79fb728e115bc99b6 Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1028116444", "metadata": {"Type": "work"}}} Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: Jun 22 09:00:34.094835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1028116444', 'metadata': {'Type': 'work'}}}} Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:34.095859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:00:34.098298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:00:34.100053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 09:00:34.100053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:34.100053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cb448a25-5e1b-414a-8263-d0cb82d4802b tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:34.101786 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cb448a25-5e1b-414a-8263-d0cb82d4802b tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.822211 Jun 22 09:00:34.108281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 09:00:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1825 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 09:00:34.589643 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4ab9e705-2a31-474a-a927-fdc7c789b48f tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Action: 'create', calling method: .version_select at 0x7fb333ed9940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1066097028"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:38.033342 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e444ef0f-8d2d-4863-8c7b-3b1a024d5184 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 6.563497 Jun 22 09:00:38.033969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 09:00:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 6566 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 22 09:00:38.040142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8c006ec0-8179-46ac-ba3c-22ecc7d311fd tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Action: 'create', calling method: .version_select at 0x7fb333e6b550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1578410792", "metadata": {"Type": "work"}}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8c006ec0-8179-46ac-ba3c-22ecc7d311fd tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Request method failure captured: Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 120 Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistowv7hNnru5-R-8tcXe6QWL8iIaPo8wqR3YUu-Pj3xoTqvGetmZ2xW_Oqw1JEyIWVa_a6-4bZPLwDDI5lfjqz3NxcNKy-2ogKM2DfYs3Kil6ldpnc-34tjpWgU2xrPG5tR9R1t6eDJFT2NQ6OmsyQo1TqlYp3_t3V-dUX20HgTLIrU Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:00:38.056878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}] Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: d9bd65bd93b645a79fb728e115bc99b6 Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1578410792", "metadata": {"Type": "work"}}} Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: Jun 22 09:00:38.058668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1578410792', 'metadata': {'Type': 'work'}}}} Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi '0' Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:38.059595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:00:38.061067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:00:38.062840 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 09:00:38.062840 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.079781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8c006ec0-8179-46ac-ba3c-22ecc7d311fd tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:38.080715 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8c006ec0-8179-46ac-ba3c-22ecc7d311fd tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045250 Jun 22 09:00:38.081295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 09:00:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:00:38.102145 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f369c01b-f9d3-4cdd-990a-e650874a6e28 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Calling method '.version_select at 0x7fb333e6b5e0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:38.247756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4ab9e705-2a31-474a-a927-fdc7c789b48f tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.143404 Jun 22 09:00:38.248618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 2/4] 10.222.0.36 () {60 vars in 1154 bytes} [Wed Jun 22 09:00:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4145 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 09:00:38.264767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7c4448fb-c3f1-4b58-b6bd-7d0275b4c8c0 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Action: 'create', calling method: .version_select at 0x7fb333dd8940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-687129314", "metadata": {"Type": "work"}}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7c4448fb-c3f1-4b58-b6bd-7d0275b4c8c0 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Request method failure captured: Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 118 Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistowv7hNnru5-R-8tcXe6QWL8iIaPo8wqR3YUu-Pj3xoTqvGetmZ2xW_Oqw1JEyIWVa_a6-4bZPLwDDI5lfjqz3NxcNKy-2ogKM2DfYs3Kil6ldpnc-34tjpWgU2xrPG5tR9R1t6eDJFT2NQ6OmsyQo1TqlYp3_t3V-dUX20HgTLIrU Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:00:38.267273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}] Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: d9bd65bd93b645a79fb728e115bc99b6 Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-687129314", "metadata": {"Type": "work"}}} Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: Jun 22 09:00:38.268878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-687129314', 'metadata': {'Type': 'work'}}}} Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise error Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi '' Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:38.269918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 09:00:38.271343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 09:00:38.273035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 09:00:38.273035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:38.273035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7c4448fb-c3f1-4b58-b6bd-7d0275b4c8c0 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:38.273035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7c4448fb-c3f1-4b58-b6bd-7d0275b4c8c0 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018973 Jun 22 09:00:38.274476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 3/5] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Jun 22 09:00:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:00:38.279013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-853ac273-4204-47f6-bc98-862801c7a3a3 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333de5790>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:38.333504 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f369c01b-f9d3-4cdd-990a-e650874a6e28 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404" status: 200 len: 353 microversion: 2.1 time: 0.236942 Jun 22 09:00:38.333986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:38 2022] GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:38.338979 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-37251e85-de55-486d-98db-50700f995e2c tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Calling method '.version_select at 0x7fb333e6b3a0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:38.451828 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-853ac273-4204-47f6-bc98-862801c7a3a3 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d" status: 200 len: 345 microversion: 2.1 time: 0.176501 Jun 22 09:00:38.452993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:38 2022] GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d => generated 345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:38.507215 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-37251e85-de55-486d-98db-50700f995e2c tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] HTTP exception thrown: Volume tempest-invalid-1087785339 could not be found. Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-37251e85-de55-486d-98db-50700f995e2c tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Request method failure captured: Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1087785339 HTTP/1.1 Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistowv7hNnru5-R-8tcXe6QWL8iIaPo8wqR3YUu-Pj3xoTqvGetmZ2xW_Oqw1JEyIWVa_a6-4bZPLwDDI5lfjqz3NxcNKy-2ogKM2DfYs3Kil6ldpnc-34tjpWgU2xrPG5tR9R1t6eDJFT2NQ6OmsyQo1TqlYp3_t3V-dUX20HgTLIrU Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:00:38.510136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}] Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: d9bd65bd93b645a79fb728e115bc99b6 Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Volume tempest-invalid-1087785339 could not be found. Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'tempest-invalid-1087785339'} Jun 22 09:00:39.086922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1087785339 could not be found. (HTTP 404) (Request-ID: req-a2099278-6b8b-421b-a5e7-6b4467e81023) Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.098260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:39.106761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1087785339 could not be found. Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:39.109629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1087785339 could not be found. Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1087785339 could not be found. Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-37251e85-de55-486d-98db-50700f995e2c tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Returning 404 to user: Volume tempest-invalid-1087785339 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-37251e85-de55-486d-98db-50700f995e2c tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1087785339" status: 404 len: 99 microversion: 2.1 time: 0.177325 Jun 22 09:00:39.118750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Jun 22 09:00:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1087785339 => generated 99 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 09:00:39.124243 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4d265607-152b-4fe8-8e8a-e23e7855b32f tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007569 Jun 22 09:00:39.124243 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 5/9] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Jun 22 09:00:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 09:00:39.125491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3bcea498-d7f1-4124-8a9b-51036dda298d tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004493 Jun 22 09:00:39.125491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 5/10] 10.222.0.36 () {58 vars in 1136 bytes} [Wed Jun 22 09:00:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7da6f04a-2991-413d-becb-725d40e858a3 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Calling method '.version_select at 0x7fb333dd8ca0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-7da6f04a-2991-413d-becb-725d40e858a3 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] HTTP exception thrown: Volume cce4f52c-1c0e-46ac-a41a-606fdb8b3eef could not be found. Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7da6f04a-2991-413d-becb-725d40e858a3 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Request method failure captured: Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: DELETE /compute/v2.1/os-volumes/cce4f52c-1c0e-46ac-a41a-606fdb8b3eef HTTP/1.1 Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistowv7hNnru5-R-8tcXe6QWL8iIaPo8wqR3YUu-Pj3xoTqvGetmZ2xW_Oqw1JEyIWVa_a6-4bZPLwDDI5lfjqz3NxcNKy-2ogKM2DfYs3Kil6ldpnc-34tjpWgU2xrPG5tR9R1t6eDJFT2NQ6OmsyQo1TqlYp3_t3V-dUX20HgTLIrU Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:00:39.126182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}] Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: d9bd65bd93b645a79fb728e115bc99b6 Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Volume cce4f52c-1c0e-46ac-a41a-606fdb8b3eef could not be found. Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'cce4f52c-1c0e-46ac-a41a-606fdb8b3eef'} Jun 22 09:00:39.128511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cce4f52c-1c0e-46ac-a41a-606fdb8b3eef could not be found. (HTTP 404) (Request-ID: req-cc72f897-aafd-4660-9acc-8ffa24aa7436) Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.129452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:39.135002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cce4f52c-1c0e-46ac-a41a-606fdb8b3eef could not be found. Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:00:39.136233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cce4f52c-1c0e-46ac-a41a-606fdb8b3eef could not be found. Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cce4f52c-1c0e-46ac-a41a-606fdb8b3eef could not be found. Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7da6f04a-2991-413d-becb-725d40e858a3 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Returning 404 to user: Volume cce4f52c-1c0e-46ac-a41a-606fdb8b3eef could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7da6f04a-2991-413d-becb-725d40e858a3 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/cce4f52c-1c0e-46ac-a41a-606fdb8b3eef" status: 404 len: 109 microversion: 2.1 time: 0.079408 Jun 22 09:00:39.137279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:00:38 2022] DELETE /compute/v2.1/os-volumes/cce4f52c-1c0e-46ac-a41a-606fdb8b3eef => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-76aacae6-3e14-4afc-8c2a-8fd3da24e3a6 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Calling method '.version_select at 0x7fb333e6b700>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-76aacae6-3e14-4afc-8c2a-8fd3da24e3a6 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] HTTP exception thrown: Volume ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 could not be found. Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-76aacae6-3e14-4afc-8c2a-8fd3da24e3a6 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Request method failure captured: Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/os-volumes/ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 HTTP/1.1 Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistowv7hNnru5-R-8tcXe6QWL8iIaPo8wqR3YUu-Pj3xoTqvGetmZ2xW_Oqw1JEyIWVa_a6-4bZPLwDDI5lfjqz3NxcNKy-2ogKM2DfYs3Kil6ldpnc-34tjpWgU2xrPG5tR9R1t6eDJFT2NQ6OmsyQo1TqlYp3_t3V-dUX20HgTLIrU Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:00:39.138210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_94a38e607db04e36a734e5074aa2bc92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/94a38e607db04e36a734e5074aa2bc92"}]}] Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 94a38e607db04e36a734e5074aa2bc92 Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesNegativeTest-1432775497 Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: d9bd65bd93b645a79fb728e115bc99b6 Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesNegativeTest-1432775497-project Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Volume ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 could not be found. Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704'} Jun 22 09:00:39.139415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 could not be found. (HTTP 404) (Request-ID: req-9da91cbf-2a09-47f5-bb53-950aaf4f8e7f) Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.140193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:39.141393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 could not be found. Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:00:39.148039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 could not be found. Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 could not be found. Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-76aacae6-3e14-4afc-8c2a-8fd3da24e3a6 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] Returning 404 to user: Volume ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-76aacae6-3e14-4afc-8c2a-8fd3da24e3a6 tempest-VolumesNegativeTest-1432775497 tempest-VolumesNegativeTest-1432775497-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704" status: 404 len: 109 microversion: 2.1 time: 0.058147 Jun 22 09:00:39.151952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:38 2022] GET /compute/v2.1/os-volumes/ccd23b61-e98d-4fe7-a9e4-c5b1cc70e704 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:39.152758 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4aae161b-7f39-4811-a73d-5af009ea0a38 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333ed9550>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:39.152758 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4aae161b-7f39-4811-a73d-5af009ea0a38 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/903e66ea-b474-4257-8200-f3b8103ca946" status: 200 len: 350 microversion: 2.1 time: 0.101084 Jun 22 09:00:39.152758 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:38 2022] GET /compute/v2.1/os-volumes/903e66ea-b474-4257-8200-f3b8103ca946 => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:39.357671 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9b47858d-75ce-415e-8792-35f90d5eae0c tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Calling method '.version_select at 0x7fb333ddca60>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:39.470248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8c52cdd5-3886-4f1a-a966-07fe695bae1b tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333dd89d0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:39.932480 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9b47858d-75ce-415e-8792-35f90d5eae0c tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404" status: 200 len: 354 microversion: 2.1 time: 0.585700 Jun 22 09:00:39.942878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:39 2022] GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404 => generated 354 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:39.952841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-43734d76-7ac1-40ac-a5ba-a8a1bbb14d2a tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Calling method '.version_select at 0x7fb333e6b550>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:40.025308 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8c52cdd5-3886-4f1a-a966-07fe695bae1b tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d" status: 200 len: 346 microversion: 2.1 time: 0.561478 Jun 22 09:00:40.028048 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:39 2022] GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d => generated 346 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:40.053479 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-236d6ab9-3f73-4457-a550-a48eb1ccccf7 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Action: 'create', calling method: .version_select at 0x7fb333dab8b0>, body: {"snapshot": {"volume_id": "be78c1ce-2c45-43f3-835a-6e5972a4396d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1010929115"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:40.253150 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-43734d76-7ac1-40ac-a5ba-a8a1bbb14d2a tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404" status: 200 len: 354 microversion: 2.1 time: 0.307330 Jun 22 09:00:40.254641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:39 2022] GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404 => generated 354 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:40.284195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7478a390-88c0-45aa-b3e6-4b82ed79c882 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Calling method '.version_select at 0x7fb333e1f790>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:41.135057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7478a390-88c0-45aa-b3e6-4b82ed79c882 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404" status: 202 len: 0 microversion: 2.1 time: 0.858581 Jun 22 09:00:41.139755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 9/17] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:00:40 2022] DELETE /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404 => generated 0 bytes in 864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:00:41.147148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-73eef1f2-3a6f-4081-b321-405db03d1366 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Calling method '.version_select at 0x7fb333ddcd30>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:41.533789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-73eef1f2-3a6f-4081-b321-405db03d1366 tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404" status: 200 len: 353 microversion: 2.1 time: 0.392378 Jun 22 09:00:41.535135 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 10/18] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:41 2022] GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404 => generated 353 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:41.553078 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-92779dda-0c84-4a9d-a148-141502e86a5e tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333ddcf70>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:41.753633 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-92779dda-0c84-4a9d-a148-141502e86a5e tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/151a93b7-6eb9-4bbb-b6e5-1515c0a5452f" status: 200 len: 350 microversion: 2.1 time: 0.216316 Jun 22 09:00:41.754567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 11/19] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:41 2022] GET /compute/v2.1/os-volumes/151a93b7-6eb9-4bbb-b6e5-1515c0a5452f => generated 350 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:41.959590 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-236d6ab9-3f73-4457-a550-a48eb1ccccf7 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.917764 Jun 22 09:00:41.961294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 9/20] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Jun 22 09:00:40 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:41.977596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-faf5fd37-d504-46fe-88cd-30e1b6f60abd tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333ddcca0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:42.556580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-701d148c-2fde-4afc-9bb9-8877781ec18b tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Calling method '.version_select at 0x7fb333dbd550>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:43.371413 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-faf5fd37-d504-46fe-88cd-30e1b6f60abd tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b" status: 200 len: 287 microversion: 2.1 time: 1.386767 Jun 22 09:00:43.371413 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 12/21] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:41 2022] GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b => generated 287 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:43.373032 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-be5499d1-88bc-40ff-a347-50bc637f4287 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333e1f550>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:43.424851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-701d148c-2fde-4afc-9bb9-8877781ec18b tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] HTTP exception thrown: Volume 80a204a2-f54b-465a-a0a6-cf11320b3404 could not be found. Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-701d148c-2fde-4afc-9bb9-8877781ec18b tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Request method failure captured: Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404 HTTP/1.1 Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistovvRQVrYxxMX7MTrNr2CLnB2KpRt1tDZpnmKMc1C21-ncAN09wX-Mtoc_ETfvjlZ7UCx1gzmxNwGnw2bup7FuC8n6wlNnO7RmPU60MkeZ-fb8R1mc338A0znAaLFwkKRTRfdDdZf45htdVhWfBgwPv8mrKnyvlkWDO0t4fP2Z7ILo Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 5d68fd77f9ad49c3bf1033cca7472bde Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesGetTestJSON-1519596341 Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:00:43.430880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d68fd77f9ad49c3bf1033cca7472bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5d68fd77f9ad49c3bf1033cca7472bde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5d68fd77f9ad49c3bf1033cca7472bde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5d68fd77f9ad49c3bf1033cca7472bde"}]}] Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesGetTestJSON-1519596341 Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 5d68fd77f9ad49c3bf1033cca7472bde Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesGetTestJSON-1519596341 Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesGetTestJSON-1519596341-project Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: d9af2154918a4c1fbee9f2ab67bee7dc Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesGetTestJSON-1519596341-project Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Volume 80a204a2-f54b-465a-a0a6-cf11320b3404 could not be found. Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '80a204a2-f54b-465a-a0a6-cf11320b3404'} Jun 22 09:00:43.432003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80a204a2-f54b-465a-a0a6-cf11320b3404 could not be found. (HTTP 404) (Request-ID: req-fca58f1d-eba2-4c5d-8964-05c5ebdfb433) Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:43.432726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:43.433624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80a204a2-f54b-465a-a0a6-cf11320b3404 could not be found. Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:00:43.436280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80a204a2-f54b-465a-a0a6-cf11320b3404 could not be found. Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80a204a2-f54b-465a-a0a6-cf11320b3404 could not be found. Jun 22 09:00:43.437354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:43.440321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-701d148c-2fde-4afc-9bb9-8877781ec18b tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] Returning 404 to user: Volume 80a204a2-f54b-465a-a0a6-cf11320b3404 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:43.442769 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-701d148c-2fde-4afc-9bb9-8877781ec18b tempest-VolumesGetTestJSON-1519596341 tempest-VolumesGetTestJSON-1519596341-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404" status: 404 len: 109 microversion: 2.1 time: 0.897043 Jun 22 09:00:43.444988 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 10/22] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:42 2022] GET /compute/v2.1/os-volumes/80a204a2-f54b-465a-a0a6-cf11320b3404 => generated 109 bytes in 900 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:43.674946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-be5499d1-88bc-40ff-a347-50bc637f4287 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.306949 Jun 22 09:00:43.676087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 13/23] 10.222.0.36 () {58 vars in 1139 bytes} [Wed Jun 22 09:00:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:00:43.688726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0c4f367b-fc6a-4961-82e8-d671faec32cc tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333dabe50>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:43.751974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0c4f367b-fc6a-4961-82e8-d671faec32cc tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b" status: 200 len: 287 microversion: 2.1 time: 0.067901 Jun 22 09:00:43.752712 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:43 2022] GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:44.768897 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-acd03f5a-b8af-4d50-a687-066caca50fee tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333e6b700>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:44.922805 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-acd03f5a-b8af-4d50-a687-066caca50fee tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b" status: 200 len: 287 microversion: 2.1 time: 0.160950 Jun 22 09:00:44.923811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:44 2022] GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:45.880648 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b2e1c2aa-c778-44f9-9866-6bd1b9a67449 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333dd8dc0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:45.936562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6b3ec28c-b201-4c62-a31f-a5e060925190 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333d8c550>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.035347 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6b3ec28c-b201-4c62-a31f-a5e060925190 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b" status: 200 len: 288 microversion: 2.1 time: 0.103551 Jun 22 09:00:46.036413 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 15/26] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:45 2022] GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b => generated 288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:46.049277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-525a5db5-9473-47b7-8710-7ea9378651b8 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333e6b670>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.062219 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b2e1c2aa-c778-44f9-9866-6bd1b9a67449 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c111408f-1d76-4777-804d-30eb78569561" status: 200 len: 350 microversion: 2.1 time: 0.185273 Jun 22 09:00:46.063726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 12/27] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:45 2022] GET /compute/v2.1/os-volumes/c111408f-1d76-4777-804d-30eb78569561 => generated 350 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:46.080162 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b350a4f1-3ce0-4300-892b-e13d1a8493d3 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333ed94c0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.440860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b350a4f1-3ce0-4300-892b-e13d1a8493d3 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.364812 Jun 22 09:00:46.442093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 13/28] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Jun 22 09:00:46 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:46.482198 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b308376d-f5be-4eae-a98a-4b1371dead9f tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333dd8790>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.501513 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-525a5db5-9473-47b7-8710-7ea9378651b8 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b" status: 202 len: 0 microversion: 2.1 time: 0.455750 Jun 22 09:00:46.505772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1253 bytes} [Wed Jun 22 09:00:46 2022] DELETE /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:00:46.521012 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8938281d-7d7a-4499-8365-72020c5d93a5 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb3347cfb80>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:46.658755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8938281d-7d7a-4499-8365-72020c5d93a5 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b" status: 200 len: 287 microversion: 2.1 time: 0.151068 Jun 22 09:00:46.659872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:46 2022] GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:46.825522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b308376d-f5be-4eae-a98a-4b1371dead9f tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.365975 Jun 22 09:00:46.827617 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1148 bytes} [Wed Jun 22 09:00:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:46.847400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ab3496ba-841f-4b30-bc23-9676691d9006 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333e1f430>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.067701 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ab3496ba-841f-4b30-bc23-9676691d9006 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.223791 Jun 22 09:00:47.067701 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1133 bytes} [Wed Jun 22 09:00:46 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:47.086034 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a94ecf85-1c14-48e5-8343-aa39b85aa439 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333dab820>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.520403 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a94ecf85-1c14-48e5-8343-aa39b85aa439 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.441909 Jun 22 09:00:47.521312 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 15/33] 10.222.0.36 () {58 vars in 1166 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:47.548601 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b5728241-990c-46fc-9a2f-103016760724 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333ddcd30>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.680125 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-73f8c270-6659-46db-9d49-2f3bc3f6f5c6 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333dbd040>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.862894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-73f8c270-6659-46db-9d49-2f3bc3f6f5c6 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] HTTP exception thrown: Snapshot 550d0bb1-c602-46dc-99ca-41be1b3b273b could not be found. Jun 22 09:00:47.868864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b5728241-990c-46fc-9a2f-103016760724 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.330954 Jun 22 09:00:47.870431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 19/34] 10.222.0.36 () {58 vars in 1169 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-73f8c270-6659-46db-9d49-2f3bc3f6f5c6 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Request method failure captured: Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b HTTP/1.1 Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistoxPgcKoSex9hbMQ2BK9IRSPm_VzV2KK2Bfu3zl2W1R7PrUX73AMcdLWSXXY5wUvOlNUJN__EIXz8y_bhsey1h42oitWWDKWwDJU3qMcj4bF0APXdnKEjErMIZgbBxJhOlfDZMepaVOqy6GdRiF0tEYy0YABzsEt3D7ikT6nkjW0tA Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:00:47.884456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3a5f9b103c0c480199b17cd359532691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}] Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: e7c4c45155234856925ea151b87e3146 Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Snapshot 550d0bb1-c602-46dc-99ca-41be1b3b273b could not be found. Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '550d0bb1-c602-46dc-99ca-41be1b3b273b'} Jun 22 09:00:47.885534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 550d0bb1-c602-46dc-99ca-41be1b3b273b could not be found. (HTTP 404) (Request-ID: req-d3fb9668-1e3a-49fc-8ecf-754d46e6ae94) Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.886212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:47.887165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 550d0bb1-c602-46dc-99ca-41be1b3b273b could not be found. Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 09:00:47.888382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 550d0bb1-c602-46dc-99ca-41be1b3b273b could not be found. Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 550d0bb1-c602-46dc-99ca-41be1b3b273b could not be found. Jun 22 09:00:47.892241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:00:47.903020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5dd531c4-a2d6-4780-a65d-d227dfd7cdca tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333e6bc10>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:47.904896 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-73f8c270-6659-46db-9d49-2f3bc3f6f5c6 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Returning 404 to user: Snapshot 550d0bb1-c602-46dc-99ca-41be1b3b273b could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:47.907686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-73f8c270-6659-46db-9d49-2f3bc3f6f5c6 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b" status: 404 len: 111 microversion: 2.1 time: 0.237483 Jun 22 09:00:47.909020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 16/35] 10.222.0.36 () {58 vars in 1250 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/os-snapshots/550d0bb1-c602-46dc-99ca-41be1b3b273b => generated 111 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:47.933118 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-44e9fee7-ef45-44c8-a245-a44569782d1b tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333dab8b0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.144894 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5dd531c4-a2d6-4780-a65d-d227dfd7cdca tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.261070 Jun 22 09:00:48.146861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 20/36] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Jun 22 09:00:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:48.163450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-68b783d1-0b06-4fd2-afbc-89430e8ceea4 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333d8c4c0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.534993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-44e9fee7-ef45-44c8-a245-a44569782d1b tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d" status: 202 len: 0 microversion: 2.1 time: 0.606177 Jun 22 09:00:48.541950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 17/37] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:00:47 2022] DELETE /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:00:48.549447 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-763c83eb-3817-4297-81b4-efc59b2394f5 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333dd8c10>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.738037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-68b783d1-0b06-4fd2-afbc-89430e8ceea4 tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.579523 Jun 22 09:00:48.739461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 21/38] 10.222.0.36 () {58 vars in 1187 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:48.761013 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-27b7b49c-e40d-458c-a808-b0174966d19b tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] Calling method '.version_select at 0x7fb333e6b3a0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:48.859162 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-763c83eb-3817-4297-81b4-efc59b2394f5 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d" status: 200 len: 345 microversion: 2.1 time: 0.316669 Jun 22 09:00:48.860958 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 18/39] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d => generated 345 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:49.061903 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-27b7b49c-e40d-458c-a808-b0174966d19b tempest-VolumesTestJSON-994995915 tempest-VolumesTestJSON-994995915-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.312886 Jun 22 09:00:49.062975 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1154 bytes} [Wed Jun 22 09:00:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:49.872887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1501a435-2bdc-448b-8ac2-973f59695052 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333e1f4c0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:50.309320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-1501a435-2bdc-448b-8ac2-973f59695052 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] HTTP exception thrown: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1501a435-2bdc-448b-8ac2-973f59695052 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Request method failure captured: Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d HTTP/1.1 Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistoxPgcKoSex9hbMQ2BK9IRSPm_VzV2KK2Bfu3zl2W1R7PrUX73AMcdLWSXXY5wUvOlNUJN__EIXz8y_bhsey1h42oitWWDKWwDJU3qMcj4bF0APXdnKEjErMIZgbBxJhOlfDZMepaVOqy6GdRiF0tEYy0YABzsEt3D7ikT6nkjW0tA Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:00:50.323072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3a5f9b103c0c480199b17cd359532691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}] Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: e7c4c45155234856925ea151b87e3146 Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'be78c1ce-2c45-43f3-835a-6e5972a4396d'} Jun 22 09:00:50.325128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. (HTTP 404) (Request-ID: req-be71aaa6-05c3-4b9f-97b7-de63bb44e2a9) Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:50.326494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:50.330243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:00:50.338324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1501a435-2bdc-448b-8ac2-973f59695052 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Returning 404 to user: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:50.345755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1501a435-2bdc-448b-8ac2-973f59695052 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d" status: 404 len: 109 microversion: 2.1 time: 0.456358 Jun 22 09:00:50.354876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 23/41] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:49 2022] GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d => generated 109 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:50.397772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-594a6358-7be0-4484-969c-d79bc51d3346 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333ddcdc0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:50.800202 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-594a6358-7be0-4484-969c-d79bc51d3346 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] HTTP exception thrown: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-594a6358-7be0-4484-969c-d79bc51d3346 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Request method failure captured: Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d HTTP/1.1 Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistoxPgcKoSex9hbMQ2BK9IRSPm_VzV2KK2Bfu3zl2W1R7PrUX73AMcdLWSXXY5wUvOlNUJN__EIXz8y_bhsey1h42oitWWDKWwDJU3qMcj4bF0APXdnKEjErMIZgbBxJhOlfDZMepaVOqy6GdRiF0tEYy0YABzsEt3D7ikT6nkjW0tA Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:00:50.804010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3a5f9b103c0c480199b17cd359532691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}] Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: e7c4c45155234856925ea151b87e3146 Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'be78c1ce-2c45-43f3-835a-6e5972a4396d'} Jun 22 09:00:50.805166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. (HTTP 404) (Request-ID: req-ad583943-42a5-4d02-becb-7e0c7f9c7773) Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:50.805778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 09:00:50.806675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 09:00:50.807638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:50.810646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-594a6358-7be0-4484-969c-d79bc51d3346 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Returning 404 to user: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:50.812658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-594a6358-7be0-4484-969c-d79bc51d3346 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d" status: 404 len: 109 microversion: 2.1 time: 0.453747 Jun 22 09:00:50.824628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 24/42] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:00:50 2022] DELETE /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d => generated 109 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:50.834041 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-119d8ea8-33f8-4db9-997e-3016f1692fa6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: .version_select at 0x7fb333f5a820>, body: {"keypair": {"name": "tempest-keypair-1835834285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsEZ88aljNlWf8Cxrdbxw5+cXjSF17hcA6tF4f+JZARAlNPvGLO7t+UGKE2dlCaGARPQNZ1dio4194zgXwsBt+tc/AiQ/BIEFZxxqURRTrOa7abtc40JKTG4dsXiCvSFQ=="}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:50.851602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6ad5e553-dcd1-4e6f-8780-175b9f4f7763 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Calling method '.version_select at 0x7fb333e6ba60>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:51.019013 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-6ad5e553-dcd1-4e6f-8780-175b9f4f7763 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] HTTP exception thrown: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6ad5e553-dcd1-4e6f-8780-175b9f4f7763 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Request method failure captured: Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d HTTP/1.1 Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistoxPgcKoSex9hbMQ2BK9IRSPm_VzV2KK2Bfu3zl2W1R7PrUX73AMcdLWSXXY5wUvOlNUJN__EIXz8y_bhsey1h42oitWWDKWwDJU3qMcj4bF0APXdnKEjErMIZgbBxJhOlfDZMepaVOqy6GdRiF0tEYy0YABzsEt3D7ikT6nkjW0tA Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:00:51.037766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3a5f9b103c0c480199b17cd359532691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3a5f9b103c0c480199b17cd359532691"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3a5f9b103c0c480199b17cd359532691"}]}] Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3a5f9b103c0c480199b17cd359532691 Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710756366 Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: e7c4c45155234856925ea151b87e3146 Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710756366-project Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'be78c1ce-2c45-43f3-835a-6e5972a4396d'} Jun 22 09:00:51.051470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. (HTTP 404) (Request-ID: req-aabdfe6e-8af6-4e93-b292-bf06c807128d) Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:51.054984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 09:00:51.058520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 09:00:51.066432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:00:51.069927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6ad5e553-dcd1-4e6f-8780-175b9f4f7763 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] Returning 404 to user: Volume be78c1ce-2c45-43f3-835a-6e5972a4396d could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:00:51.071738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-119d8ea8-33f8-4db9-997e-3016f1692fa6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:00:51.071883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6ad5e553-dcd1-4e6f-8780-175b9f4f7763 tempest-VolumesSnapshotsTestJSON-1710756366 tempest-VolumesSnapshotsTestJSON-1710756366-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d" status: 404 len: 109 microversion: 2.1 time: 0.215770 Jun 22 09:00:51.074800 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 25/43] 10.222.0.36 () {58 vars in 1244 bytes} [Wed Jun 22 09:00:50 2022] GET /compute/v2.1/os-volumes/be78c1ce-2c45-43f3-835a-6e5972a4396d => generated 109 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:00:51.081714 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-119d8ea8-33f8-4db9-997e-3016f1692fa6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:00:51.378535 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-119d8ea8-33f8-4db9-997e-3016f1692fa6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.619073 Jun 22 09:00:51.380038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 19/44] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:00:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:00:52.150523 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-702070713", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "networks": [{"uuid": "87e2804d-8228-4766-8ec6-545eb3833c79"}]}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:52.673209 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] validate_networks() for [('87e2804d-8228-4766-8ec6-545eb3833c79', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:00:53.213176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-166987218", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:53.467633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] validate_networks() for [('81450ca5-339e-4f08-bdc8-ec0a189d1628', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:00:56.253037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:00:56.253583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:00:56.260676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:00:56.261237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:00:56.264546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:00:56.278904 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.279356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.280257 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.280686 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.321866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Getting quotas for project 6257cf2b40a84e66a1d77b0b2485c462. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:00:56.328093 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Getting quotas for user b6b3995abf0047f4b9bfa7061300567e and project 6257cf2b40a84e66a1d77b0b2485c462. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:00:56.343477 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:00:56.348724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:00:56.575099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f701bbf3-8a6b-410d-ac44-82f66f4f937b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.721322 Jun 22 09:00:56.579663 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 26/45] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 4727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:00:56.594442 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e793ea41-08ee-49a0-a2e3-f1e58a489c47 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:56.597470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e793ea41-08ee-49a0-a2e3-f1e58a489c47 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:56.612426 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:00:56.612970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:00:56.613493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:00:56.615950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:00:56.616476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:00:56.631913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.632423 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.633341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:56.635173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:56.713432 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:00:56.739781 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for user c5c6763ac1ea47da89d3bb29d630b48c and project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:00:56.758672 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:00:56.764891 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:00:56.874893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e793ea41-08ee-49a0-a2e3-f1e58a489c47 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:56.904798 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e793ea41-08ee-49a0-a2e3-f1e58a489c47 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1214 microversion: 2.1 time: 0.319706 Jun 22 09:00:56.915979 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 27/46] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:56 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1214 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:57.035910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e472d4a8-4bef-4281-a60d-be7f85a6bfc2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.189391 Jun 22 09:00:57.042222 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 20/47] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:00:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 4197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:00:57.047586 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ccb25db8-4e45-4eb9-a543-3715159af87e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:57.048441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ccb25db8-4e45-4eb9-a543-3715159af87e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:57.213261 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ccb25db8-4e45-4eb9-a543-3715159af87e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:57.236061 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ccb25db8-4e45-4eb9-a543-3715159af87e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1221 microversion: 2.1 time: 0.192390 Jun 22 09:00:57.239732 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 28/48] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:57 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1221 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:57.499129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-21267123", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:57.591259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] validate_networks() for [('81450ca5-339e-4f08-bdc8-ec0a189d1628', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:00:57.923915 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-409322d4-a6a3-4512-88d1-52bd2e18ee5d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:57.924863 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-409322d4-a6a3-4512-88d1-52bd2e18ee5d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:58.074844 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-409322d4-a6a3-4512-88d1-52bd2e18ee5d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:58.084893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-409322d4-a6a3-4512-88d1-52bd2e18ee5d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1214 microversion: 2.1 time: 0.164573 Jun 22 09:00:58.092286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 29/49] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:57 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:00:58.168931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1000354699", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89fc451c-46b3-4008-9c5d-bc37135b61a8"}], "security_groups": [{"name": "tempest-securitygroup--516248378"}], "key_name": "tempest-keypair-1835834285", "user_data": "}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:00:58.422584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] validate_networks() for [('89fc451c-46b3-4008-9c5d-bc37135b61a8', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:00:58.442930 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:00:58.444207 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:00:58.445116 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:00:58.445867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:00:58.446640 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:00:58.499987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:58.500703 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:58.502527 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:58.503500 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:58.595587 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:00:58.600732 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for user c5c6763ac1ea47da89d3bb29d630b48c and project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:00:58.627388 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:00:58.629530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:00:58.907310 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1d8c6383-121e-431c-935c-39a9d41a2552 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.413272 Jun 22 09:00:58.914159 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 21/50] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:00:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:00:58.931337 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7a65c2e0-1dcd-4f0c-bd9b-f2291f2771a0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:58.936442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7a65c2e0-1dcd-4f0c-bd9b-f2291f2771a0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:59.100934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7a65c2e0-1dcd-4f0c-bd9b-f2291f2771a0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:59.151327 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7a65c2e0-1dcd-4f0c-bd9b-f2291f2771a0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1220 microversion: 2.1 time: 0.235600 Jun 22 09:00:59.154803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 22/51] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:58 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1220 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:59.175122 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9e02d418-b9b6-4ca0-aa59-6eeb4dc6fc21 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:59.180016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9e02d418-b9b6-4ca0-aa59-6eeb4dc6fc21 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:00:59.392842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9e02d418-b9b6-4ca0-aa59-6eeb4dc6fc21 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:00:59.395096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:00:59.399141 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:00:59.400621 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:00:59.407076 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:00:59.408223 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:00:59.434805 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9e02d418-b9b6-4ca0-aa59-6eeb4dc6fc21 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1214 microversion: 2.1 time: 0.277876 Jun 22 09:00:59.450294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 23/52] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:59 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:00:59.454650 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:59.455196 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:59.461247 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:00:59.462025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:00:59.487739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:00:59.494612 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:00:59.512328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:00:59.515391 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:00:59.799144 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ffeb01d7-c00c-487d-a37e-f4b22b04a2e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.635628 Jun 22 09:00:59.801361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 30/53] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:00:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:00:59.825362 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-35e962a0-bfb1-4d45-b48b-d583a3348977 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:00:59.825362 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-35e962a0-bfb1-4d45-b48b-d583a3348977 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:00.029610 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-35e962a0-bfb1-4d45-b48b-d583a3348977 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:00.054928 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-35e962a0-bfb1-4d45-b48b-d583a3348977 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1242 microversion: 2.1 time: 0.241527 Jun 22 09:01:00.062422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 24/54] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:00:59 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:00.176156 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6a5ead75-6d92-4383-8a8f-bd21249ea715 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:00.176892 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6a5ead75-6d92-4383-8a8f-bd21249ea715 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:00.276373 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6a5ead75-6d92-4383-8a8f-bd21249ea715 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:00.289538 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6a5ead75-6d92-4383-8a8f-bd21249ea715 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1220 microversion: 2.1 time: 0.121592 Jun 22 09:01:00.326744 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 31/55] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:00 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1220 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:00.463469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-25b982b4-aa21-4984-b47e-5d183fff0f4f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:00.464612 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-25b982b4-aa21-4984-b47e-5d183fff0f4f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.091556 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-db27799a-bcdc-42fb-a139-b1a26277cf37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:01.094141 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-db27799a-bcdc-42fb-a139-b1a26277cf37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.321296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-25b982b4-aa21-4984-b47e-5d183fff0f4f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:01.332883 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-25b982b4-aa21-4984-b47e-5d183fff0f4f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1214 microversion: 2.1 time: 0.877416 Jun 22 09:01:01.353692 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 25/56] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:00 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1214 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:01.358944 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:01.359583 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:01.404673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.405373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.406488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:01.417600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:01.549594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-db27799a-bcdc-42fb-a139-b1a26277cf37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:01.616221 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-db27799a-bcdc-42fb-a139-b1a26277cf37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1242 microversion: 2.1 time: 0.534167 Jun 22 09:01:01.617158 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 32/57] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:01 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1242 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:01.916300 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:01.956702 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f699436c-fd78-49b6-99e7-dae119973584 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1224 microversion: 2.1 time: 0.601254 Jun 22 09:01:01.958002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 26/58] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:01 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1224 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:02.357595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:02.357595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:02.398093 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:02.399570 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:02.402129 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:02.403114 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:02.652979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:02.654480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:02.689080 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:02.709163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:02.713716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:02.721174 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:02.725877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:02.749793 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-faa177fa-5f56-46ab-b69e-3880d52cf36d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1266 microversion: 2.1 time: 0.401142 Jun 22 09:01:02.750909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 33/59] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:02 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1266 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:02.947377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:02.980483 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:02.981172 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:02.992432 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b52e1290-69eb-43a8-91d6-f7d95fed61a7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1246 microversion: 2.1 time: 0.346323 Jun 22 09:01:02.994669 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 27/60] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:02 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1246 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:03.001027 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:03.002453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:03.004663 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:03.010396 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:03.221947 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:03.244036 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8b314755-8f5c-417a-b4ff-06bad1207211 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1272 microversion: 2.1 time: 0.270773 Jun 22 09:01:03.250883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 34/61] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:02 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:03.780598 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:03.781589 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:03.812897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:03.813438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:03.814317 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:03.827476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:04.028695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:04.030106 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:04.041962 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:04.051519 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:04.056645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:04.059434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:04.659370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:04.671750 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6ed023db-60d4-4fd1-8875-ece5ffa0b5f6 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1274 microversion: 2.1 time: 0.898257 Jun 22 09:01:04.676126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 28/62] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:03 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1274 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:04.692102 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:04.700653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:04.726670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:04.727418 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:04.728389 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:04.729561 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:04.971374 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:04.982025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ae11a950-b4ee-42fc-a53c-b48017062945 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1294 microversion: 2.1 time: 0.961264 Jun 22 09:01:04.983153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 35/63] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:04 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1294 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:05.104721 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:05.113868 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f3f2cfd7-d772-481f-9f6a-b5ecbbbf05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1290 microversion: 2.1 time: 0.425391 Jun 22 09:01:05.116078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 29/64] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:04 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1290 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:05.714406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:05.716386 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:05.733941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:05.735270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:05.736288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:05.740846 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:06.006155 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:06.007653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:06.022551 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:06.023301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:06.024928 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:06.027938 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:06.082166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:06.093117 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0057e110-b376-478a-aa02-62941a6270ba tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1272 microversion: 2.1 time: 0.402936 Jun 22 09:01:06.106821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 36/65] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:05 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1272 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:06.134097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:06.134977 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:06.142631 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:06.143588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:06.145230 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:06.145965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:06.766582 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:06.766582 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1e19f4b6-b9ea-4c89-b2fa-8d63afdf46aa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1278 microversion: 2.1 time: 0.335693 Jun 22 09:01:06.766582 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 37/66] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:06 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1278 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:06.767234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:06.767234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4dea5391-37fe-4c93-bc02-298df1a45563 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1300 microversion: 2.1 time: 0.481324 Jun 22 09:01:06.767234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 30/67] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:06 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1300 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:07.116102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:07.117028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:07.126371 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.128450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:07.132941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.132941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:07.228358 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:07.243986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d7a3d064-03a0-4d4d-82f2-ff574290ddbc tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1272 microversion: 2.1 time: 0.133948 Jun 22 09:01:07.258812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 38/68] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:07 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:07.774640 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:07.775520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:07.776056 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:07.780532 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:07.793347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.793815 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:07.794693 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.795135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:07.797590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.798123 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:07.799129 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:07.799616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:08.200933 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:08.211834 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ac628511-ca55-4b3b-b50d-942b2712df38 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1300 microversion: 2.1 time: 0.442302 Jun 22 09:01:08.213649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 39/69] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:07 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1300 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:08.270375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:08.270375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:08.290359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:08.303597 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:08.303597 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:08.303597 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:08.535198 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=4 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:08.862031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:08.874911 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f3fb9b41-d99d-4a03-bf76-34985f7bbd6b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.609899 Jun 22 09:01:08.877262 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 40/70] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:08 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:08.966209 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:08.977442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8c028efb-3dcd-4047-892f-6a686a9c95e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 1.213760 Jun 22 09:01:08.978876 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 31/71] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:07 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:09.235840 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:09.238289 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:09.258737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:09.259893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:09.260795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:09.262631 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:09.470843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:09.588708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:09.615451 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-742c53cb-7ab1-4995-a849-2d75a7acc14b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1300 microversion: 2.1 time: 0.383797 Jun 22 09:01:09.647755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 41/72] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:09 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1300 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:09.893961 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:09.894880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:09.921245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:09.922241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:09.931136 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:09.932474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:10.000489 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:10.001579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:10.062289 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:10.071620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:10.073258 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:10.073961 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:11.333181 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=24 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:11.563304 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:11.575252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5f1d6c63-0fc6-4a6a-90f9-76285f38374d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 1.583315 Jun 22 09:01:11.576201 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 42/73] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:09 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:11.581646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:11.587511 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:11.588132 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:11.591009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=22 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:11.607069 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0e598e07-e909-48fa-8964-9c8c6f64ccb1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 1.717268 Jun 22 09:01:11.607658 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 32/74] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:09 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:11.624068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:11.624068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:11.624068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:11.624068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:12.396245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:12.416009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fb2c724d-4f1e-440a-b19a-a1d7ef30469b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.829513 Jun 22 09:01:12.416009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 43/75] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:11 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:12.593159 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:12.593793 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:12.596098 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:12.613522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:12.620233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:12.620233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:12.620233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:12.632713 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:12.633593 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:12.644223 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:12.645004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:12.646817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:12.647543 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:13.269107 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:13.308652 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-51c18010-95a8-4a24-a4ec-e4e6bc4b7986 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.719103 Jun 22 09:01:13.309886 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 33/76] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:12 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:13.529977 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:13.572096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-82ab319d-b4a6-4610-8be9-ffaadc9df154 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.944186 Jun 22 09:01:13.602226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 44/77] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:12 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:13.612788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:13.616704 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:13.631268 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:13.639754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:13.639754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:13.639754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:13.769312 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-d0a971cc-e306-498f-8d52-47b3d15adeb2 req-0b577895-5a95-4687-8b8f-527e0daef08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5de6423-e83b-4fcb-a9f2-2e9465c838dd", "tag": "7d4f28bf-7d12-46f2-804e-2946377a0181"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:13.799010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d0a971cc-e306-498f-8d52-47b3d15adeb2 req-0b577895-5a95-4687-8b8f-527e0daef08c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:13.800074 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d0a971cc-e306-498f-8d52-47b3d15adeb2 req-0b577895-5a95-4687-8b8f-527e0daef08c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:13.823365 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-d0a971cc-e306-498f-8d52-47b3d15adeb2 req-0b577895-5a95-4687-8b8f-527e0daef08c service nova] Creating event network-changed:7d4f28bf-7d12-46f2-804e-2946377a0181 for instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd on hv-cinder-78729 Jun 22 09:01:13.823895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d0a971cc-e306-498f-8d52-47b3d15adeb2 req-0b577895-5a95-4687-8b8f-527e0daef08c service nova] Acquired lock "compute-rpcapi-router" {{(pid=118029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 09:01:13.827557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d90985e1-b659-463e-acfc-cafe7d7a6c35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:13.827557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d90985e1-b659-463e-acfc-cafe7d7a6c35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:13.827557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d90985e1-b659-463e-acfc-cafe7d7a6c35 None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:13.827557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d90985e1-b659-463e-acfc-cafe7d7a6c35 None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:13.837085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.compute.rpcapi [None req-d90985e1-b659-463e-acfc-cafe7d7a6c35 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 09:01:13.838522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d90985e1-b659-463e-acfc-cafe7d7a6c35 None None] Releasing lock "compute-rpcapi-router" {{(pid=118029) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 09:01:13.861902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d90985e1-b659-463e-acfc-cafe7d7a6c35 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.549343 Jun 22 09:01:13.863158 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 34/78] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:14.431346 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:14.438872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-90aafbf1-4113-43ab-acc9-2a862fb870e5 req-a54fc89d-c234-48eb-a2c3-4005bff1b39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc7f9a5-4c83-48ef-95c8-bae4ee26e491", "tag": "04477f09-b620-439f-8678-baafc48d8bf5"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:14.451532 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c3ed673a-8195-48be-aa5b-aefd2aab063d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.847183 Jun 22 09:01:14.469861 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-90aafbf1-4113-43ab-acc9-2a862fb870e5 req-a54fc89d-c234-48eb-a2c3-4005bff1b39d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:14.470335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-90aafbf1-4113-43ab-acc9-2a862fb870e5 req-a54fc89d-c234-48eb-a2c3-4005bff1b39d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:14.474540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 45/79] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:13 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:14.479589 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:14.482701 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:14.518181 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:14.518924 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:14.520241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:14.520971 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:14.525326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-90aafbf1-4113-43ab-acc9-2a862fb870e5 req-a54fc89d-c234-48eb-a2c3-4005bff1b39d service nova] Creating event network-changed:04477f09-b620-439f-8678-baafc48d8bf5 for instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 on hv-cinder-78729 Jun 22 09:01:14.548821 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-90aafbf1-4113-43ab-acc9-2a862fb870e5 req-a54fc89d-c234-48eb-a2c3-4005bff1b39d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.618583 Jun 22 09:01:14.554586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 35/80] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:01:14.625996 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:14.627257 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:14.636175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:14.637297 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:14.638736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:14.647592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:15.471265 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:15.539014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d7cf657a-d614-412b-92e5-9f9630ae6fb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 1.061191 Jun 22 09:01:15.561801 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 46/81] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:14 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:15.589479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:15.590827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:15.622304 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:15.631821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:15.633698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:15.638397 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:16.199599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:16.215979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-de6b6f97-04e7-4f11-81e2-9d698101fc83 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 1.608343 Jun 22 09:01:16.220337 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 36/82] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:14 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:16.573199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:16.573818 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:16.589105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:16.589997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:16.591891 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:16.594251 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.038357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:17.038357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5b3a54ef-bbe4-451f-9b35-c421a308f07a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 1.461919 Jun 22 09:01:17.042926 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 47/83] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:15 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:17.060529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-05d0172e-dc36-4be9-b814-cb4fc5347d88 req-7041d9fb-c209-4000-9800-8639cd0c8fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4127e9-161c-4421-ab41-0115e64e2e02", "tag": "63c4c500-8059-4142-83d0-d1cd70284258"}, {"name": "network-changed", "server_uuid": "4728bbe3-835f-4432-b8a2-bd1ff5352341", "tag": "0b34c90a-22d5-4720-ad3f-ff0d35f7ded7"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:17.097751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-05d0172e-dc36-4be9-b814-cb4fc5347d88 req-7041d9fb-c209-4000-9800-8639cd0c8fa3 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:17.102425 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-05d0172e-dc36-4be9-b814-cb4fc5347d88 req-7041d9fb-c209-4000-9800-8639cd0c8fa3 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.185839 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-05d0172e-dc36-4be9-b814-cb4fc5347d88 req-7041d9fb-c209-4000-9800-8639cd0c8fa3 service nova] Creating event network-changed:63c4c500-8059-4142-83d0-d1cd70284258 for instance 8d4127e9-161c-4421-ab41-0115e64e2e02 on hv-cinder-78729 Jun 22 09:01:17.195743 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-05d0172e-dc36-4be9-b814-cb4fc5347d88 req-7041d9fb-c209-4000-9800-8639cd0c8fa3 service nova] Creating event network-changed:0b34c90a-22d5-4720-ad3f-ff0d35f7ded7 for instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 on hv-cinder-78729 Jun 22 09:01:17.196852 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-05d0172e-dc36-4be9-b814-cb4fc5347d88 req-7041d9fb-c209-4000-9800-8639cd0c8fa3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 09:01:17.198884 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a72aea7c-2a3e-4a1a-aac9-0c47ee24eddf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:17.199525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a72aea7c-2a3e-4a1a-aac9-0c47ee24eddf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.200420 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a72aea7c-2a3e-4a1a-aac9-0c47ee24eddf None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:17.200928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a72aea7c-2a3e-4a1a-aac9-0c47ee24eddf None None] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.228975 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.compute.rpcapi [None req-a72aea7c-2a3e-4a1a-aac9-0c47ee24eddf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 09:01:17.230006 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a72aea7c-2a3e-4a1a-aac9-0c47ee24eddf None None] Releasing lock "compute-rpcapi-router" {{(pid=118028) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 09:01:17.287420 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a72aea7c-2a3e-4a1a-aac9-0c47ee24eddf None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.242879 Jun 22 09:01:17.288453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 48/84] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:17.297493 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:17.303225 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:17.322330 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:17.324876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.324876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:17.325650 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:17.336732 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:18.003040 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:18.015938 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-16ddf1ff-41ad-4341-8359-b3d723a57217 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 1.445094 Jun 22 09:01:18.015938 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 37/85] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:16 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:18.069963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:18.071308 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:18.086040 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:18.105610 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1cda18a9-5261-4d6e-8325-1144d443a531 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.815294 Jun 22 09:01:18.107044 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 49/86] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:17 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:18.117147 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:18.117793 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:18.118849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:18.119485 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:18.961933 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:18.975272 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c9c299a6-738c-479c-9aed-3b2bfd018185 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.933042 Jun 22 09:01:18.977902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 38/87] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:18 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:19.039041 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:19.041241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:19.056997 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:19.058108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:19.059475 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:19.060107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:19.130586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:19.133833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:19.145736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:19.146831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:19.152812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:19.152812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:19.650146 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:19.657568 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:19.675349 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f9dba8cf-1c18-46f7-a01c-c273a5d2505d tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.553839 Jun 22 09:01:19.690548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fdede74d-b8e2-4d78-949d-21cf12bf9eda tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.646864 Jun 22 09:01:19.690724 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 39/88] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:19 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:19.690871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 50/89] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:19 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:20.011968 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:20.019536 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:20.035819 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.038978 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:20.040439 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.044738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:20.387996 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:20.399066 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-290c0135-1721-4acf-821a-84e2bde24e3d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.399995 Jun 22 09:01:20.399701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 40/90] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:19 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:20.718975 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:20.720455 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:20.730509 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.730624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:20.730719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:20.731063 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:20.731383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.731905 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:20.754427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.755595 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:20.757172 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:20.758156 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:21.270649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:21.280256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6f14fdbe-c211-4a46-8316-ffb4aac3991f tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.568777 Jun 22 09:01:21.280995 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 51/91] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:20 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:21.296207 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:21.307429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-80df802a-d4d9-43cf-998e-b94e1731d6c7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.585533 Jun 22 09:01:21.307429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 41/92] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:20 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:21.417469 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:21.418103 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:21.424472 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:21.425171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:21.425938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:21.426562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:21.666406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:21.679859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0f4835fb-a417-4075-854e-5125dc521a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.266487 Jun 22 09:01:21.694178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 52/93] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:21 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:22.297959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:22.298734 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:22.305885 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.306799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.307836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.308350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.330004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:22.330004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:22.330004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:22.335095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.336367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.338401 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.340452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.561554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:22.571194 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:22.586281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:22.592197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-48cf6b3a-72d3-43f3-86a2-56eaab80cf05 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.272364 Jun 22 09:01:22.596897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-29af6d1f-b8b3-41c0-bd09-735769fa4726 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.303127 Jun 22 09:01:22.597722 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 42/94] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:22 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:22.603443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 53/95] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:22 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:22.707168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:22.708257 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:22.715155 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.715798 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.716772 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:22.717199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:22.881041 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:22.888424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3e2df58c-0bdf-4ff7-b2b3-461f5e1dc242 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.185155 Jun 22 09:01:22.889856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 43/96] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:22 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:23.611118 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:23.611724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:23.619964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.621367 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:23.621825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.621930 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:23.622619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.623226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.632691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.632691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.632691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.632691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.836605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:23.911438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:23.920911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6a573b6c-be28-48b7-978d-453d541bfbef tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.304344 Jun 22 09:01:23.921531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 44/97] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:23 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:23.931592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:23.932516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:23.939686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.940394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.941392 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:23.943709 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:23.950883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:23.967944 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-893ee67a-47b7-4dac-abb0-4903dba32e6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.360972 Jun 22 09:01:23.970799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 54/98] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:23 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:24.180783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:24.189809 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3c8b433f-176a-4fdc-9247-227e42899dbf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.267079 Jun 22 09:01:24.190637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 45/99] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:23 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:24.949692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:24.952676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:24.959635 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:24.960578 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:24.961360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:24.961789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:25.003972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:25.003972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:25.005357 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:25.005874 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:25.007037 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:25.007725 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:25.286723 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:25.298946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0f101d21-bc67-44a7-bd7c-b6dc97431d61 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.354096 Jun 22 09:01:25.301931 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:25.310208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 55/100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:24 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:25.311092 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-52d1cc0e-172c-43e4-ab00-7765d74fa631 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.318635 Jun 22 09:01:25.311873 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 46/101] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:24 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:25.321065 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:25.321065 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:25.326245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:25.327038 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:25.327876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:25.328270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:25.524372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:25.532813 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-17051b1e-af74-4180-bf41-d58867cf2cd5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.221424 Jun 22 09:01:25.533393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 56/102] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:25 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:26.328188 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:26.328188 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:26.343604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:26.344023 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:26.344522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.345301 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:26.350077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:26.350896 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.354470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:26.355470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.358867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:26.360800 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.745051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:26.750344 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:26.770916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6f184508-46e6-4f82-b0c8-d7eb4bf97ead tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.430688 Jun 22 09:01:26.774586 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 57/103] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:26 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:26.774718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5fd2d8a1-623b-47bc-9227-bb020bfcef51 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.460487 Jun 22 09:01:26.786103 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 47/104] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:26 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:26.791640 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:26.793260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:26.803277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:26.803721 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.804664 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:26.805263 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:26.986535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:26.998633 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-93711bfd-6146-48b9-a463-51d1dadff1ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.224731 Jun 22 09:01:27.000510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 58/105] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:26 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:27.423241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-36c31b66-0185-427a-b81d-1445996ee574 req-8a99e840-6d5e-4c93-b5bb-b29e0d7c16e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc7f9a5-4c83-48ef-95c8-bae4ee26e491", "name": "network-vif-plugged", "status": "completed", "tag": "04477f09-b620-439f-8678-baafc48d8bf5"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:27.423241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-36c31b66-0185-427a-b81d-1445996ee574 req-8a99e840-6d5e-4c93-b5bb-b29e0d7c16e0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:27.423241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-36c31b66-0185-427a-b81d-1445996ee574 req-8a99e840-6d5e-4c93-b5bb-b29e0d7c16e0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:27.452213 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-36c31b66-0185-427a-b81d-1445996ee574 req-8a99e840-6d5e-4c93-b5bb-b29e0d7c16e0 service nova] Creating event network-vif-plugged:04477f09-b620-439f-8678-baafc48d8bf5 for instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 on hv-cinder-78729 Jun 22 09:01:27.460894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-36c31b66-0185-427a-b81d-1445996ee574 req-8a99e840-6d5e-4c93-b5bb-b29e0d7c16e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.681912 Jun 22 09:01:27.462178 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 48/106] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:27.798467 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:27.799253 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:27.800654 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:27.801812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:27.807976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:27.810270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:27.810878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:27.812286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:27.812955 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:27.815623 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:27.819148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:27.821117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:27.822866 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:28.192122 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:28.210197 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cf22fabd-96d2-4c74-9ac7-d5f74cb3e75f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.415712 Jun 22 09:01:28.219470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 49/107] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:27 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:28.226502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:28.227385 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:28.235707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:28.236505 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:28.237524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:28.238200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:28.255472 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:28.269388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c7d41305-2bc2-49e7-8e31-4b9f42b24920 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.475202 Jun 22 09:01:28.276899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 59/108] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:27 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:28.458612 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:28.471821 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-52402fe1-1a38-421f-ab6a-e8062bfb9312 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.250797 Jun 22 09:01:28.473766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 50/109] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:28 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:29.233702 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:29.234893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:29.243447 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.243562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.244619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.245246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.291575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:29.292486 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:29.300376 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.306646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.306646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.306646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.494336 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:29.511867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fd8112e0-82d6-4ebc-b18a-7eef6e883a1c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.287310 Jun 22 09:01:29.515588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 60/110] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:29 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:29.527154 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:29.534107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:29.548651 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.549417 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.550491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.551964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.567823 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:29.583360 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-41be449a-755a-4e26-8b70-17522b726715 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.297685 Jun 22 09:01:29.585087 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 51/111] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:29 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:29.681890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-8c50aa4d-1d39-4e05-b225-eadb62eedd1c req-cbb177c0-1f95-4640-a8cb-2a7dd3626e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4127e9-161c-4421-ab41-0115e64e2e02", "name": "network-vif-plugged", "status": "completed", "tag": "63c4c500-8059-4142-83d0-d1cd70284258"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:29.716534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-8c50aa4d-1d39-4e05-b225-eadb62eedd1c req-cbb177c0-1f95-4640-a8cb-2a7dd3626e86 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:29.719624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-8c50aa4d-1d39-4e05-b225-eadb62eedd1c req-cbb177c0-1f95-4640-a8cb-2a7dd3626e86 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:29.746859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-8c50aa4d-1d39-4e05-b225-eadb62eedd1c req-cbb177c0-1f95-4640-a8cb-2a7dd3626e86 service nova] Creating event network-vif-plugged:63c4c500-8059-4142-83d0-d1cd70284258 for instance 8d4127e9-161c-4421-ab41-0115e64e2e02 on hv-cinder-78729 Jun 22 09:01:29.755602 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-8c50aa4d-1d39-4e05-b225-eadb62eedd1c req-cbb177c0-1f95-4640-a8cb-2a7dd3626e86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085012 Jun 22 09:01:29.763068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 52/112] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:29.870491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:29.897780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-21411587-c2d8-43e6-b65b-57eaa4b459ed tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.378672 Jun 22 09:01:29.913371 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 61/113] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:29 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:30.541973 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:30.542972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:30.553392 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:30.559659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:30.565839 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:30.566884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:30.612046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:30.612890 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:30.626022 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:30.626493 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:30.627297 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:30.627722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:30.939685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:30.949330 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:30.955211 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f404ff64-4027-45c0-bb05-6a4dcbc4a0e4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.417477 Jun 22 09:01:30.969328 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 53/114] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:30 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:30.970144 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c5d06a51-c80b-4375-8206-291d61c5e0de tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1314 microversion: 2.1 time: 0.362246 Jun 22 09:01:30.970700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 62/115] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:30 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:31.001021 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:31.003326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:31.010661 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:31.011354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:31.012668 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:31.013268 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:31.309588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:31.320460 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-768af2ab-3a38-4b66-8bea-97aa0a774d11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.349306 Jun 22 09:01:31.321898 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 54/116] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:30 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:31.774231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-b4f5e5cd-0a2f-4bd0-84ef-c903db7750e7 req-ead36019-2464-477c-a32b-afc3473b7094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4728bbe3-835f-4432-b8a2-bd1ff5352341", "name": "network-vif-plugged", "status": "completed", "tag": "0b34c90a-22d5-4720-ad3f-ff0d35f7ded7"}, {"server_uuid": "d5de6423-e83b-4fcb-a9f2-2e9465c838dd", "name": "network-vif-plugged", "status": "completed", "tag": "7d4f28bf-7d12-46f2-804e-2946377a0181"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:31.784868 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-b4f5e5cd-0a2f-4bd0-84ef-c903db7750e7 req-ead36019-2464-477c-a32b-afc3473b7094 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:31.785938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-b4f5e5cd-0a2f-4bd0-84ef-c903db7750e7 req-ead36019-2464-477c-a32b-afc3473b7094 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:31.804121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-b4f5e5cd-0a2f-4bd0-84ef-c903db7750e7 req-ead36019-2464-477c-a32b-afc3473b7094 service nova] Creating event network-vif-plugged:0b34c90a-22d5-4720-ad3f-ff0d35f7ded7 for instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 on hv-cinder-78729 Jun 22 09:01:31.804864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-b4f5e5cd-0a2f-4bd0-84ef-c903db7750e7 req-ead36019-2464-477c-a32b-afc3473b7094 service nova] Creating event network-vif-plugged:7d4f28bf-7d12-46f2-804e-2946377a0181 for instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd on hv-cinder-78729 Jun 22 09:01:31.842619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-b4f5e5cd-0a2f-4bd0-84ef-c903db7750e7 req-ead36019-2464-477c-a32b-afc3473b7094 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073021 Jun 22 09:01:31.844788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 63/117] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:31.977271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:31.977271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:31.977271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:31.987033 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:31.994516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:31.995253 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:31.999281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:31.999909 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:32.021249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:32.021709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:32.022539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:32.022977 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:32.308245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:32.320039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e5cd6c67-6741-437b-acfb-947e5564f12a tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1501 microversion: 2.1 time: 0.330206 Jun 22 09:01:32.332698 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:32.333248 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 64/118] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:31 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1501 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:32.347266 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ba382d41-d0c7-4965-92da-72392aa71ad0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.375149 Jun 22 09:01:32.349731 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 55/119] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:31 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:32.353221 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:32.354397 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:32.365572 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:32.367716 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:32.367716 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:32.368159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:32.688109 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:32.695804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-22d80fb3-b60a-4b21-93e9-8bf3249ad6d5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.351771 Jun 22 09:01:32.696466 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 65/120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:32 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:33.376442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:33.377586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:33.389017 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:33.389797 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:33.390737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:33.391942 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:33.687367 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:33.703239 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f2c68421-2808-4e9e-a5ce-a91134da75f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.340253 Jun 22 09:01:33.708947 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 56/121] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:33 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:33.720304 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:33.721243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:33.729445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:33.733682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:33.735006 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:33.735746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:33.761661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:33.962721 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:33.973426 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4372fa20-2a09-4057-b20d-cc5f02ce4dbd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1367 microversion: 2.1 time: 0.256155 Jun 22 09:01:33.974017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 66/122] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:33 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:34.578598 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3e451386-d9b1-4119-b53e-69ca798a3ad1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "296cf612-ab81-41c1-a890-f2b08f5ae453"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:34.580416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3e451386-d9b1-4119-b53e-69ca798a3ad1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:34.587799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e451386-d9b1-4119-b53e-69ca798a3ad1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:34.588258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e451386-d9b1-4119-b53e-69ca798a3ad1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:34.589102 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e451386-d9b1-4119-b53e-69ca798a3ad1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:34.589537 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e451386-d9b1-4119-b53e-69ca798a3ad1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:34.731748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:34.733751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:34.759803 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:34.759803 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:34.759803 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:34.759803 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:34.932051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:34.942724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-365c4ad3-7836-4487-95cb-e9b1b7229728 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1320 microversion: 2.1 time: 0.216370 Jun 22 09:01:34.952625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 67/123] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:34 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:35.001572 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:35.011257 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:35.021085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.021592 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:35.022799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.023399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:35.211699 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:35.223615 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-362aef4d-3699-4724-90f2-ba3917efce95 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1555 microversion: 2.1 time: 0.235317 Jun 22 09:01:35.224608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 68/124] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:34 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:35.243462 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7036cfed-9252-4c6b-b668-f2e0e95f7fa4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:35.244049 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7036cfed-9252-4c6b-b668-f2e0e95f7fa4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:35.254858 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7036cfed-9252-4c6b-b668-f2e0e95f7fa4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.254858 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7036cfed-9252-4c6b-b668-f2e0e95f7fa4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:35.254858 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7036cfed-9252-4c6b-b668-f2e0e95f7fa4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.254858 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7036cfed-9252-4c6b-b668-f2e0e95f7fa4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:35.406792 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7036cfed-9252-4c6b-b668-f2e0e95f7fa4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168394 Jun 22 09:01:35.414700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 69/125] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:01:35 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:01:35.963983 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:35.965890 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:35.976812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.977656 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:35.979051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:35.979820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:36.226339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:36.242030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c0f599f4-dfe7-4b47-b153-8d0f9ce6ddd3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1513 microversion: 2.1 time: 0.284070 Jun 22 09:01:36.243574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 70/126] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:35 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:36.273121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:36.274724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:36.284443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:36.285671 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:36.287040 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:36.287575 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:36.331931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lazy-loading 'flavor' on Instance uuid d5de6423-e83b-4fcb-a9f2-2e9465c838dd {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:01:36.355774 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3e451386-d9b1-4119-b53e-69ca798a3ad1 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "POST /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.781448 Jun 22 09:01:36.357976 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 57/127] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:01:34 2022] POST /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491/os-volume_attachments => generated 194 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:01:36.856193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7748dccf-8902-43e3-9bb0-e6c3f7be12af tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd/action" status: 200 len: 32 microversion: 2.1 time: 0.590976 Jun 22 09:01:36.857408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 71/128] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:01:36 2022] POST /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd/action => generated 32 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:01:36.869375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:36.870389 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:36.877754 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:36.878249 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:36.879552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:36.879995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:37.065232 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:37.076728 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9db70618-584b-4663-98b2-a941dade122e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.213128 Jun 22 09:01:37.087747 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 58/129] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:36 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:37.613604 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-28f1d92b-36bc-4f4d-937d-0d796eed4931 req-e374c0f9-5ce6-4d1d-8690-6cdf53c3cb4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4728bbe3-835f-4432-b8a2-bd1ff5352341", "tag": "0b34c90a-22d5-4720-ad3f-ff0d35f7ded7"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:37.624194 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-28f1d92b-36bc-4f4d-937d-0d796eed4931 req-e374c0f9-5ce6-4d1d-8690-6cdf53c3cb4d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:37.625168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-28f1d92b-36bc-4f4d-937d-0d796eed4931 req-e374c0f9-5ce6-4d1d-8690-6cdf53c3cb4d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:37.639269 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-28f1d92b-36bc-4f4d-937d-0d796eed4931 req-e374c0f9-5ce6-4d1d-8690-6cdf53c3cb4d service nova] Creating event network-changed:0b34c90a-22d5-4720-ad3f-ff0d35f7ded7 for instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 on hv-cinder-78729 Jun 22 09:01:37.645173 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-28f1d92b-36bc-4f4d-937d-0d796eed4931 req-e374c0f9-5ce6-4d1d-8690-6cdf53c3cb4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036581 Jun 22 09:01:37.649615 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 72/130] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:38.095231 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:38.096035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:38.104687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:38.106358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:38.107260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:38.107703 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:38.156021 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:38.402653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:38.411067 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9f7888bf-6b4c-4f65-8306-faaddad5207d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.319657 Jun 22 09:01:38.411900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 59/131] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:38 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:39.436682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:39.437675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:39.447034 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:39.447661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:39.448490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:39.449016 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:39.636870 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:39.646043 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-94aa9fb1-f7f9-4ca4-9887-02dbd101e5fa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.214159 Jun 22 09:01:39.646658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 73/132] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:39 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:40.671574 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:40.674196 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:40.687210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:40.688493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:40.689972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:40.691267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:41.256858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:41.256858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4324316a-abb1-4774-953b-4b46bd397908 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.252604 Jun 22 09:01:41.256858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 60/133] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:40 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:42.044207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:42.044855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:42.051544 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:42.051999 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:42.052765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:42.053199 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:42.266357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:42.285259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-cef3687a-7516-47bf-84c2-edd00dddd9cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.244075 Jun 22 09:01:42.286302 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 74/134] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:42 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:43.305701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:43.311435 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:43.314614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:43.315122 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:43.316490 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:43.316932 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:43.516090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:43.524137 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-34c97a4e-20ae-4fe7-ba9c-54c99ac521ca tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.223629 Jun 22 09:01:43.524724 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 61/135] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:43 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:44.547154 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:44.548009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:44.556708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:44.557408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:44.559276 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:44.560002 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:44.713405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:44.722215 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ecc91a87-59c1-4996-af1a-d0b58232ac52 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.181046 Jun 22 09:01:44.722998 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 75/136] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:44 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:45.742329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:45.742926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:45.752600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:45.752600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:45.752600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:45.752600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:45.951695 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:45.970987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1b7e5905-8b21-4008-8ad9-b95a262543bc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.235308 Jun 22 09:01:45.983327 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 62/137] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:45 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:46.145259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:46.145259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:46.161099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:46.161936 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:46.163395 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:46.164623 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:46.208742 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:01:46.834862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-994a5d17-49f8-44ae-8e03-7627effa891c tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 204 len: 0 microversion: 2.1 time: 0.702405 Jun 22 09:01:46.836094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 76/138] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:01:46 2022] DELETE /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:01:46.848675 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:46.849616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:46.875223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:46.875223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:46.875877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:46.876320 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:46.991848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:46.994683 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:47.001993 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:47.002493 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:47.003409 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:47.003853 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:47.043176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:47.051407 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f295cc90-ba65-414b-9587-b6779b5fbe15 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1553 microversion: 2.1 time: 0.210498 Jun 22 09:01:47.052144 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 63/139] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:46 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:47.181230 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:47.190420 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d226f122-4674-4224-993b-1a020f878c61 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.205043 Jun 22 09:01:47.201256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 77/140] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:46 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:48.070652 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:48.071275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:48.072954 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=62 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:48.089072 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:48.089072 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:48.089072 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:48.089859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:48.211072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:48.212244 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:48.223859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:48.224596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:48.225861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:48.237782 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:48.258034 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:48.268902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6878d1b3-a66a-48d6-922b-139a781a91e8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1553 microversion: 2.1 time: 0.203752 Jun 22 09:01:48.269574 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 64/141] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:48 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:48.422778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:48.430638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5fe593d4-af61-41f4-aff7-1aac2c42acbc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.226117 Jun 22 09:01:48.431299 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 78/142] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:48 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:49.288947 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:49.289875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:49.298799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:49.306347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:49.306347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:49.306347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:49.448977 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:49.450525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:49.461205 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:49.461920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:49.463217 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:49.464099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:49.663810 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:49.672401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b25a7d28-f02c-4520-986e-b45f35a81ef8 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1553 microversion: 2.1 time: 0.389743 Jun 22 09:01:49.672989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 65/143] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:49 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:49.719200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:49.730680 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d79e1fa2-3551-4dda-bd62-17f73ef584e0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.285824 Jun 22 09:01:49.730680 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 79/144] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:49 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:50.042682 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-9c77a5db-2774-4419-9e28-cf125d8c8ec9 req-a7f84476-bdc3-47e4-9352-256a866cfba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc7f9a5-4c83-48ef-95c8-bae4ee26e491", "name": "network-vif-deleted", "tag": "04477f09-b620-439f-8678-baafc48d8bf5"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:01:50.057434 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-9c77a5db-2774-4419-9e28-cf125d8c8ec9 req-a7f84476-bdc3-47e4-9352-256a866cfba5 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.058345 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-9c77a5db-2774-4419-9e28-cf125d8c8ec9 req-a7f84476-bdc3-47e4-9352-256a866cfba5 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.083192 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-9c77a5db-2774-4419-9e28-cf125d8c8ec9 req-a7f84476-bdc3-47e4-9352-256a866cfba5 service nova] Creating event network-vif-deleted:04477f09-b620-439f-8678-baafc48d8bf5 for instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 on hv-cinder-78729 Jun 22 09:01:50.095878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-9c77a5db-2774-4419-9e28-cf125d8c8ec9 req-a7f84476-bdc3-47e4-9352-256a866cfba5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064033 Jun 22 09:01:50.096755 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 66/145] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:01:50.693349 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:50.693940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:50.703662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.704160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.704968 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.705410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.730271 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:50.753605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:50.755176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:50.784716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.785163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.786316 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:50.786911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:50.820087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:50.834750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-584885bf-018b-41d6-8e1a-993b2acd8e87 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1345 microversion: 2.1 time: 0.146031 Jun 22 09:01:50.851906 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 80/146] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:50 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:51.046007 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:51.062500 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f0b6961e-bf98-4e0d-93d3-0ddd2a42a29b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.317279 Jun 22 09:01:51.063629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 67/147] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:50 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:51.860365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:51.861301 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:51.868622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:51.869072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:51.869843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:51.870384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:51.957963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:51.966571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ce9482ee-0116-40ea-86b2-344a9e51a640 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1345 microversion: 2.1 time: 0.110988 Jun 22 09:01:51.976899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 81/148] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:51 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:52.086196 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:52.086766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:52.092972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:52.093422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:52.094227 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:52.094661 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:52.242236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:52.250566 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f94aa677-1d3a-4aac-88bd-65fd472b7b97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.169494 Jun 22 09:01:52.251142 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 68/149] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:52 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:52.985170 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:52.993455 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:53.005549 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.005992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.006824 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.007253 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.063280 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.064102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.064865 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lazy-loading 'fault' on Instance uuid 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:01:53.128630 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:53.137274 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-89dc9e58-30a2-4199-99f5-a3ed99764c6e tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1350 microversion: 2.1 time: 0.156638 Jun 22 09:01:53.137859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 82/150] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:52 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:53.268119 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:53.268861 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:53.275849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.276305 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.277067 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:53.277722 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:53.445476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:53.464960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ae262ada-7892-4887-8334-839a51238c8c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.198458 Jun 22 09:01:53.464960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 69/151] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:53 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:54.161524 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:54.171547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:54.171547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.171547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.172549 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.173232 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.219430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.219901 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.220403 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lazy-loading 'fault' on Instance uuid 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:01:54.275467 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b3995abf0047f4b9bfa7061300567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6257cf2b40a84e66a1d77b0b2485c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:54.286306 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f5ecf4fc-3e02-4a96-912a-18a01679695b tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 200 len: 1350 microversion: 2.1 time: 0.130582 Jun 22 09:01:54.286903 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 83/152] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:54 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:54.480493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:54.481140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:54.489566 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.490025 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.490841 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:54.491269 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:54.657342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:54.666419 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c4d098e9-6e1d-4106-a405-e4bb1458b2dd tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.190149 Jun 22 09:01:54.668170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 70/153] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:54 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:55.307933 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:55.314673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:55.314673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:55.326159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.327851 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.329214 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.330281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.356673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] HTTP exception thrown: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Request method failure captured: Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 HTTP/1.1 Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpDE_UsXyugk3RgHsxqioxWHU1akoXLSe7IYjP5JIc3FY3RyTwPb81UychtzWHHD6mWZZAH21GSqRiZh-H9Q0QYKr8IY0kIBHCpTZEKizi7F4NWfkNJVArWcy2OGoBXPmSQdkT5ZhGJ8A7z15re-WNXexIeUa_SN7fn2itGF_4D0S0 Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:01:55.365052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}] Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-DeleteServersTestJSON-240333863 Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: b6b3995abf0047f4b9bfa7061300567e Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.367324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '0dc7f9a5-4c83-48ef-95c8-bae4ee26e491'} Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:01:55.368591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.372986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.378535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Returning 404 to user: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:01:55.378535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-40f16f99-70ff-43c6-af25-3bf5f4825989 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 404 len: 111 microversion: 2.1 time: 0.067494 Jun 22 09:01:55.378535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 84/154] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:55 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:01:55.686897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:55.688021 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:55.697801 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.698284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.699065 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.699518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.863981 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:55.871891 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-739da638-4307-4e1c-97d6-d563a115e25a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.191759 Jun 22 09:01:55.873590 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 71/155] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:55 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:01:55.875747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:55.876742 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:55.885207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.885662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.886479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:55.886918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:55.903051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] HTTP exception thrown: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Request method failure captured: Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491/os-volume_attachments HTTP/1.1 Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpDE_UsXyugk3RgHsxqioxWHU1akoXLSe7IYjP5JIc3FY3RyTwPb81UychtzWHHD6mWZZAH21GSqRiZh-H9Q0QYKr8IY0kIBHCpTZEKizi7F4NWfkNJVArWcy2OGoBXPmSQdkT5ZhGJ8A7z15re-WNXexIeUa_SN7fn2itGF_4D0S0 Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:01:55.904479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}] Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-DeleteServersTestJSON-240333863 Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: b6b3995abf0047f4b9bfa7061300567e Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.906087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'server_id': '0dc7f9a5-4c83-48ef-95c8-bae4ee26e491'} Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:01:55.915025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:01:55.916471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:01:55.917725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Returning 404 to user: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:01:55.917725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-627796f2-1420-4328-a768-3c84a5bbf376 tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035122 Jun 22 09:01:55.917725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 85/156] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:01:55 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:01:56.896653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:56.904100 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:56.908227 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:56.908678 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:56.910013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:56.910487 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:57.078446 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:57.090050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dec0756a-736a-41c4-a4b4-bf971b22c969 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.200680 Jun 22 09:01:57.090671 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 72/157] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:56 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:58.108107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:58.108928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:58.116620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:58.117087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:58.117919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:58.118309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:58.260477 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:58.269935 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-576c961a-d283-4806-9031-5928cca2cea9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.165497 Jun 22 09:01:58.270751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 86/158] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:58 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:01:59.287291 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:01:59.287902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:01:59.294522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:59.295033 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:59.295811 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:01:59.296246 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:01:59.501940 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:01:59.511113 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-58d45b43-0e07-4138-8017-69953475eea2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.227664 Jun 22 09:01:59.512271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 73/159] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:01:59 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:00.301875 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:00.301875 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:00.309084 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:00.309388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:00.310257 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:00.310823 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:00.328984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] HTTP exception thrown: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Request method failure captured: Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 HTTP/1.1 Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpDE_UsXyugk3RgHsxqioxWHU1akoXLSe7IYjP5JIc3FY3RyTwPb81UychtzWHHD6mWZZAH21GSqRiZh-H9Q0QYKr8IY0kIBHCpTZEKizi7F4NWfkNJVArWcy2OGoBXPmSQdkT5ZhGJ8A7z15re-WNXexIeUa_SN7fn2itGF_4D0S0 Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:02:00.330958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}] Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-DeleteServersTestJSON-240333863 Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: b6b3995abf0047f4b9bfa7061300567e Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.333787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '0dc7f9a5-4c83-48ef-95c8-bae4ee26e491'} Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:02:00.340169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.350546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.352309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Returning 404 to user: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:02:00.352309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-52f79aae-f786-4074-82c1-d6e95f1f22fa tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 404 len: 111 microversion: 2.1 time: 0.037848 Jun 22 09:02:00.352309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 87/160] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:02:00 2022] DELETE /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:02:00.352670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:00.352670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] [instance: 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:00.359042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:00.359748 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:00.360637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:00.361075 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:00.377063 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] HTTP exception thrown: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Request method failure captured: Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 HTTP/1.1 Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpDE_UsXyugk3RgHsxqioxWHU1akoXLSe7IYjP5JIc3FY3RyTwPb81UychtzWHHD6mWZZAH21GSqRiZh-H9Q0QYKr8IY0kIBHCpTZEKizi7F4NWfkNJVArWcy2OGoBXPmSQdkT5ZhGJ8A7z15re-WNXexIeUa_SN7fn2itGF_4D0S0 Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:02:00.382807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6257cf2b40a84e66a1d77b0b2485c462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6257cf2b40a84e66a1d77b0b2485c462"}]}] Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-DeleteServersTestJSON-240333863 Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 6257cf2b40a84e66a1d77b0b2485c462 Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-DeleteServersTestJSON-240333863 Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: b6b3995abf0047f4b9bfa7061300567e Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-DeleteServersTestJSON-240333863-project Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.384229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '0dc7f9a5-4c83-48ef-95c8-bae4ee26e491'} Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:02:00.384994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. Jun 22 09:02:00.386259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:02:00.388033 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] Returning 404 to user: Instance 0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:02:00.388033 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8c5364a0-244d-4b6c-899e-df3324883bff tempest-DeleteServersTestJSON-240333863 tempest-DeleteServersTestJSON-240333863-project] 10.222.0.36 "GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491" status: 404 len: 111 microversion: 2.1 time: 0.045450 Jun 22 09:02:00.389241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 74/161] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:00 2022] GET /compute/v2.1/servers/0dc7f9a5-4c83-48ef-95c8-bae4ee26e491 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:02:00.529839 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:00.530394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:00.536636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:00.537074 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:00.537829 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:00.538291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:00.804510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:00.818786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e56e6ed7-4294-44ab-9ba9-4cf86af49c01 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.291989 Jun 22 09:02:00.834609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 88/162] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:00 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:01.845401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:01.846552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:01.862579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:01.862986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:01.863777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:01.864211 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:02.304373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:02.343700 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8880c8a6-a508-4315-b1bd-f3a3d4f84d21 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.502153 Jun 22 09:02:02.344304 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 75/163] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:01 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:03.361976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:03.363394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:03.370923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:03.371489 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:03.372424 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:03.372855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:03.524197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:03.532074 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3cf0bf6d-53b8-4a03-ab2e-89a5660fad41 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.175126 Jun 22 09:02:03.532741 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 89/164] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:03 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:04.549778 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:04.551630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:04.564480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:04.565767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:04.566618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:04.567230 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:04.894652 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:04.924921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-49a61591-cda3-4daf-b5ae-d8cb5b1ee743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.379167 Jun 22 09:02:04.934450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 76/165] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:04 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:05.956369 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:05.957534 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:05.967471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:05.968196 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:05.969202 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:05.969700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:06.140463 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:06.149335 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-14a4c6f7-1249-4ebd-a3a3-874d04e9a14e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.200643 Jun 22 09:02:06.149898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 90/166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:05 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:07.169069 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:07.169932 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:07.177214 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:07.177658 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:07.178469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:07.178921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:07.199746 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:07.320084 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:07.328903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2d764d98-8be5-435f-9dcc-48d1da62e3fe tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.163769 Jun 22 09:02:07.329488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 77/167] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:07 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:08.347843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:08.348591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:08.354705 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:08.355138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:08.355896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:08.356436 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:08.533917 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:08.543928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-34405ebb-7cc9-415c-b292-1d5425a10736 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.200329 Jun 22 09:02:08.544475 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 91/168] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:08 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:09.574320 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:09.574320 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:09.574320 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:09.574320 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:09.575163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:09.575163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:09.743887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:09.751581 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-01829f25-92f9-4c47-90a6-4e7a55adbc82 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.193047 Jun 22 09:02:09.752742 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 78/169] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:09 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:10.770335 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:10.770946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:10.780458 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:10.783789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:10.787381 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:10.788021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:10.974670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:11.005775 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-aef8439d-10eb-4bd5-bb1d-06353f4a290c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1519 microversion: 2.1 time: 0.231896 Jun 22 09:02:11.006687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 92/170] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:10 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:12.034520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:12.036308 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:12.071210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:12.072056 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:12.076245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:12.077613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:12.434431 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:12.448544 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3bf7c589-8d9d-441d-a025-ef4576057123 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1499 microversion: 2.1 time: 0.428394 Jun 22 09:02:12.450123 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 79/171] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:12 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1499 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:12.471554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:12.472270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:12.479956 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:12.480396 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:12.485238 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:12.487845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:12.761568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:12.776333 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2a0eac4e-a5d9-47c3-927a-b7818b3646e8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1515 microversion: 2.1 time: 0.312747 Jun 22 09:02:12.777744 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 93/172] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:12 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1515 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:15.080401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:15.081746 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:15.092870 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:15.093567 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:15.094641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:15.095256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:15.134176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lazy-loading 'flavor' on Instance uuid 8d4127e9-161c-4421-ab41-0115e64e2e02 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:02:15.809312 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-67de8f0f-4e3a-458f-9a07-e09a3707569d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02/action" status: 200 len: 32 microversion: 2.1 time: 0.745034 Jun 22 09:02:15.812826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 80/173] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:02:15 2022] POST /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02/action => generated 32 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:02:15.821706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:15.822443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:15.836411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:15.836920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:15.840832 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:15.841833 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:16.506011 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:16.518254 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-52638dbf-59c7-48ce-9068-debda5e5a254 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.700379 Jun 22 09:02:16.521743 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 94/174] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:15 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:17.070117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a10d6976-22f8-4d10-962e-647a6b82d8cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'create', calling method: .version_select at 0x7fb332109c10>, body: {"keypair": {"name": "tempest-keypair-1854460297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDwz5sPv7bOIpLjfVc2oSrbmWYzS295q9V85SOF2gepeY392vwe6R29lD8tQYfS2FCwGBEBjEHwBaqgwp+oCitnz1Wii7eDoab06n/PLgYuXLPqiwbcUyPC5J+lGYcB8w=="}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:17.137200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-a10d6976-22f8-4d10-962e-647a6b82d8cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for project ec813daa61ab4ac59a2197042fb35325. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:17.146039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-a10d6976-22f8-4d10-962e-647a6b82d8cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for user dd07859f7aba4b908b2779af70a5f5e1 and project ec813daa61ab4ac59a2197042fb35325. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:17.316895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a10d6976-22f8-4d10-962e-647a6b82d8cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.577003 Jun 22 09:02:17.317575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 81/175] 10.222.0.36 () {62 vars in 1199 bytes} [Wed Jun 22 09:02:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 579 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 09:02:17.546535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:17.547155 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:17.554434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:17.554882 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:17.555665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:17.556102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:17.875990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:17.890687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-20df728a-6349-4da6-a242-aa2ec507311a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.347929 Jun 22 09:02:17.892025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 95/176] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:17 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:18.918182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:18.919516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:18.938396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:18.942692 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:18.960242 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:18.961066 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:19.413779 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:19.425750 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9b06b24d-ef49-4987-bf41-bfb1a076c6f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.518811 Jun 22 09:02:19.427264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 82/177] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:18 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:20.447972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:20.449206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:20.471449 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:20.472104 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:20.472887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:20.484156 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:20.848529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:20.863821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-234ba093-8c6e-4f26-b59d-75b7f554add1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.422506 Jun 22 09:02:20.864612 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 96/178] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:20 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:21.526098 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-432643235", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15257489-695d-400e-ba82-cb5e772f9bd0"}], "security_groups": [{"name": "tempest-securitygroup--74705859"}], "key_name": "tempest-keypair-1854460297", "user_data": "}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:21.535656 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:21.729338 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] validate_networks() for [('15257489-695d-400e-ba82-cb5e772f9bd0', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:02:21.887046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:21.888793 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:21.909713 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:21.910549 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:21.911623 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:21.912265 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:22.240607 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:22.257714 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-252a8256-11ee-4ab9-a11c-eb1bd9b6c951 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.377187 Jun 22 09:02:22.263678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 97/179] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:21 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:22.669222 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:02:22.670340 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:02:22.671274 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:02:22.672544 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:02:22.674273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:02:22.692345 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:22.692965 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:22.694404 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:22.694975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:22.723642 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for project ec813daa61ab4ac59a2197042fb35325. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:22.731017 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for user dd07859f7aba4b908b2779af70a5f5e1 and project ec813daa61ab4ac59a2197042fb35325. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:22.750780 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:02:22.754259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:02:22.992774 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3e7c5a46-f430-4661-b2be-a55631a50d9f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.471393 Jun 22 09:02:23.002096 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 83/180] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Jun 22 09:02:21 2022] POST /compute/v2.1/servers => generated 400 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 09:02:23.008414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5104be95-1e0a-4ddf-99a6-191d2b4a4dcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:23.010422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5104be95-1e0a-4ddf-99a6-191d2b4a4dcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:23.185935 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5104be95-1e0a-4ddf-99a6-191d2b4a4dcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:23.212963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5104be95-1e0a-4ddf-99a6-191d2b4a4dcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:23.216799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5104be95-1e0a-4ddf-99a6-191d2b4a4dcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:23.219031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5104be95-1e0a-4ddf-99a6-191d2b4a4dcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1281 microversion: 2.20 time: 0.218597 Jun 22 09:02:23.234113 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 98/181] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:22 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:23.285309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:23.285921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:23.297166 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:23.297676 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:23.299672 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:23.300126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:23.453298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:23.464836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6ec9c49f-6f7f-4fb5-b999-1f519bc1a832 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.185349 Jun 22 09:02:23.477510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 84/182] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:23 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:24.244801 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a4a0c506-f0e3-450e-856a-d740a3547416 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:24.246490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a4a0c506-f0e3-450e-856a-d740a3547416 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:24.331537 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a4a0c506-f0e3-450e-856a-d740a3547416 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:24.352067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a4a0c506-f0e3-450e-856a-d740a3547416 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:24.369355 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a4a0c506-f0e3-450e-856a-d740a3547416 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:24.374141 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a4a0c506-f0e3-450e-856a-d740a3547416 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1281 microversion: 2.20 time: 0.131201 Jun 22 09:02:24.383031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 99/183] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:24 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1281 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:24.484980 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:24.493982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:24.495071 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:24.495722 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:24.497425 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:24.501997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:24.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e6b60cec-15f4-4518-911c-c7793e27f8d7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:24.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e6b60cec-15f4-4518-911c-c7793e27f8d7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:24.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e6b60cec-15f4-4518-911c-c7793e27f8d7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:24.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e6b60cec-15f4-4518-911c-c7793e27f8d7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:24.735441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e6b60cec-15f4-4518-911c-c7793e27f8d7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:24.735441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e6b60cec-15f4-4518-911c-c7793e27f8d7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:24.736295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:24.736295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-259e0931-6720-46b7-8f18-b82e24fd7776 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.247055 Jun 22 09:02:24.736295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 85/184] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:24 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:24.757123 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:24.766317 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e6b60cec-15f4-4518-911c-c7793e27f8d7 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/ips" status: 200 len: 148 microversion: 2.1 time: 0.083194 Jun 22 09:02:24.774254 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 100/185] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:02:24 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/ips => generated 148 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:25.395429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:25.396349 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:25.405919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:25.409013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:25.411466 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:25.412221 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:25.726383 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:25.745556 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:25.747057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:25.759579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:25.760869 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:25.761866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:25.763121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:25.801222 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:25.816833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:25.822445 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0993285a-fe47-45f9-ba2b-2463a3f484f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1285 microversion: 2.20 time: 0.431597 Jun 22 09:02:25.849191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 86/186] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:25 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1285 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:25.977576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:25.995647 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-75f268e5-8b67-4709-97e4-73e224bd0b2b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.254219 Jun 22 09:02:25.997389 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 101/187] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:25 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:26.868692 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:26.869421 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:26.911474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:26.912191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:26.913141 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:26.913758 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:27.018485 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:27.019851 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:27.031095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:27.033143 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:27.034791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:27.036097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:27.078869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:27.103434 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:27.107090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:27.113364 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b743a912-b58b-4882-bfa4-45892dc85b10 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1277 microversion: 2.20 time: 0.249055 Jun 22 09:02:27.116397 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 87/188] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:26 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:27.246602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:27.255544 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1f3b9f93-2efc-4bdb-b7ca-581b7f8a4f32 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.243234 Jun 22 09:02:27.268527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 102/189] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:27 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:28.134480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:28.135363 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:28.145120 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:28.145818 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:28.146859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:28.147545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:28.254458 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:28.286378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:28.299759 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:28.311299 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:28.317596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:28.318899 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-92a51d44-8b38-4f3a-858d-295460c956d0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1277 microversion: 2.20 time: 0.188908 Jun 22 09:02:28.321207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:28.321743 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 88/190] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:28 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:28.322092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:28.323308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:28.323965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:28.636200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:28.646429 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-52b657fd-f016-4f25-907c-329cf3448488 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.377020 Jun 22 09:02:28.650134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 103/191] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:28 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:29.339655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:29.340365 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:29.354387 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:29.356110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:29.358486 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:29.359214 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:29.504131 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:29.517408 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:29.519912 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:29.521315 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c0c673d8-6712-4b8d-af82-4c7bc0cbc2c0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1333 microversion: 2.20 time: 0.185677 Jun 22 09:02:29.528166 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 89/192] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:29 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1333 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:29.669616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:29.670705 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:29.686245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:29.687441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:29.689114 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:29.690147 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:29.889679 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:29.904670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fbbbe4e6-199b-4749-8ecd-b69aae3eb6e1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.240732 Jun 22 09:02:29.905365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 104/193] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:29 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:30.545680 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:30.546911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:30.566290 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.570941 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:30.572567 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.573163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:30.685141 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:30.697970 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ce4d227e-fa77-4712-b502-23761fb84744 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fd93d07-1299-43a9-beb4-d5a8cdc85a57"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:30.700859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ce4d227e-fa77-4712-b502-23761fb84744 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:30.702781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=46 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:30.708941 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:30.721390 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:30.721511 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce4d227e-fa77-4712-b502-23761fb84744 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.722600 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce4d227e-fa77-4712-b502-23761fb84744 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:30.723840 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce4d227e-fa77-4712-b502-23761fb84744 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.742233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3b6508d4-30cd-404e-bfaa-2c9892cbf02e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1339 microversion: 2.20 time: 0.186259 Jun 22 09:02:30.742608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ce4d227e-fa77-4712-b502-23761fb84744 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:30.742698 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 90/194] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:30 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:30.926408 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:30.928181 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:30.940262 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.941190 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:30.942256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:30.942865 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:31.192556 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:31.210146 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a5c128a7-d3bc-4e8e-8648-b8145a9da6d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.290599 Jun 22 09:02:31.216678 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 91/195] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:30 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:31.755995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:31.757365 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:31.773903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:31.775267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:31.776728 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:31.777591 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:32.002161 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:32.010982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:32.012494 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:32.013613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-feacae53-d142-4a10-b204-f3a5b7f74980 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.267402 Jun 22 09:02:32.014354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 92/196] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:31 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:32.228374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:32.229151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:32.236053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:32.239221 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:32.240324 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:32.241368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:32.335550 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ce4d227e-fa77-4712-b502-23761fb84744 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.644243 Jun 22 09:02:32.337277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 105/197] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:02:30 2022] POST /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 194 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:02:32.438205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:32.441806 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:32.449580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0ec95561-fea4-4660-af7b-2e31898301c0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.225126 Jun 22 09:02:32.452275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 93/198] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:32 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:33.035855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:33.036813 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:33.051482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:33.052721 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:33.057375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:33.058878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:33.392127 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:33.402336 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:33.403905 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:33.414954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2cdca740-05c6-41c1-8a5d-eac3568f01e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.386172 Jun 22 09:02:33.418021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 106/199] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:33 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:33.468501 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:33.469845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:33.472565 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:33.483559 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=10 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:33.495347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:33.496989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:33.498100 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:33.499040 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:33.740616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:33.753661 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a7d482f5-acd5-45aa-a776-55f6459c206b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.291096 Jun 22 09:02:33.755651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 94/200] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:33 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:34.473574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:34.475477 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:34.502698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:34.505795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:34.513918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:34.535653 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:34.535653 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:34.774855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:34.776103 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:34.798851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:34.798851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:34.798851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:34.798851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:35.146729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:35.156375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:35.159229 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:35.160750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ec052e57-907d-42e6-831e-8bbfffadb500 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.728096 Jun 22 09:02:35.162598 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 107/201] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:34 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:35.168919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:35.177842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-addbf6cc-6165-4650-843e-68dfa66c4743 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.409287 Jun 22 09:02:35.186407 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 95/202] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:34 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:35.474125 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1080011836", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "networks": [{"uuid": "2af2e494-609c-486f-90c0-df3b055f7328"}]}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:35.573693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] validate_networks() for [('2af2e494-609c-486f-90c0-df3b055f7328', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:02:36.181959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:36.182614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:36.207738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.207738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.207738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.207738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.636388 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:36.648523 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:36.664625 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:36.666618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-94cec6a7-a124-49cc-956f-006b597199cb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.489063 Jun 22 09:02:36.667742 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 96/203] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:36 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:36.679895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:36.679895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:36.692317 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.692774 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.697762 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.698470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.943423 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:02:36.944390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:02:36.945196 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:02:36.945746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:02:36.946337 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:02:36.957826 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.958574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.959632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:36.960255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:36.995981 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Getting quotas for project 9beb16c610a94371b896183858e4c1d5. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:37.002813 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Getting quotas for user e4eae42e04bd49ecae3fd63cd5b52a43 and project 9beb16c610a94371b896183858e4c1d5. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:37.021146 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:02:37.024662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:02:37.087292 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:37.102994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dee3818b-6547-4c57-9fd5-c35e16f1ab3e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.433960 Jun 22 09:02:37.103580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 97/204] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:36 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:37.108288 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-d6172515-f5b0-40d6-a11e-dfc2daa04860 req-f3dfa201-724c-4a2a-92f7-e43b0570f546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570dea14-f80c-45cc-9935-7cf6d445d337", "tag": "be31663b-fa96-458a-8d8e-4d90d98f36db"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:37.124510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d6172515-f5b0-40d6-a11e-dfc2daa04860 req-f3dfa201-724c-4a2a-92f7-e43b0570f546 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:37.125037 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d6172515-f5b0-40d6-a11e-dfc2daa04860 req-f3dfa201-724c-4a2a-92f7-e43b0570f546 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:37.154275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-d6172515-f5b0-40d6-a11e-dfc2daa04860 req-f3dfa201-724c-4a2a-92f7-e43b0570f546 service nova] Creating event network-changed:be31663b-fa96-458a-8d8e-4d90d98f36db for instance 570dea14-f80c-45cc-9935-7cf6d445d337 on hv-cinder-78729 Jun 22 09:02:37.164373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-d6172515-f5b0-40d6-a11e-dfc2daa04860 req-f3dfa201-724c-4a2a-92f7-e43b0570f546 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059049 Jun 22 09:02:37.165323 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 98/205] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:37.229386 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ad790927-a46b-49ba-a396-8b362422dd83 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759722 Jun 22 09:02:37.230622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 108/206] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:02:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:02:37.247335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e5e59a6d-da48-4a4a-adbe-1fac4e68479e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:37.248083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e5e59a6d-da48-4a4a-adbe-1fac4e68479e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:37.325992 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e5e59a6d-da48-4a4a-adbe-1fac4e68479e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:37.340042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e5e59a6d-da48-4a4a-adbe-1fac4e68479e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1214 microversion: 2.1 time: 0.096823 Jun 22 09:02:37.353046 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 99/207] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:37 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:37.686681 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:37.687286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:37.694365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:37.694804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:37.695573 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:37.696003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:37.889264 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:37.905383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:37.909613 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:37.912298 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7faeea38-908a-4e81-ba60-6a7873de0b3c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.229614 Jun 22 09:02:37.929599 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 109/208] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:37 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:38.130627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:38.135599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:38.152617 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:38.153846 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:38.155708 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:38.157255 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:38.362231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1ad663a9-073d-44c7-9098-846e81b5ad52 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:38.363041 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1ad663a9-073d-44c7-9098-846e81b5ad52 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:38.540061 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1ad663a9-073d-44c7-9098-846e81b5ad52 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:38.542694 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:38.551923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1ad663a9-073d-44c7-9098-846e81b5ad52 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1214 microversion: 2.1 time: 0.195493 Jun 22 09:02:38.552206 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3f71233d-48f5-4174-8393-a1f89b51f52e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.433501 Jun 22 09:02:38.561512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 100/209] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:38 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:38.564539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 110/210] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:38 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:38.942000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:38.943008 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:38.950034 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:38.950679 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:38.951531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:38.952071 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.212124 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:39.224418 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:39.225957 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:39.227191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-27276ae2-91da-45ca-b5d9-fd68815d4660 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.290369 Jun 22 09:02:39.227750 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 101/211] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:38 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:39.573124 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:39.574125 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-04bb69e0-fce3-4eaa-bd37-367eaa3d1fef tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Action: 'create', calling method: .version_select at 0x7fb3328c6310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1316151461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcAwcZ/Vz4BKxtrXyxDiJpYizLc7NgdFDm15OEfQyC8sa/SgPQ8m8PMl5lsq5cKEJqOMO7l4pQBAKDn9tw4Q45uQ9ne2+Yo+CEsCHLN0BzHZL/RT2J9EWYbvAG8RyF2rg=="}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:39.574556 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:39.583848 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.584236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.585060 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.585516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.618716 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-04bb69e0-fce3-4eaa-bd37-367eaa3d1fef tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Getting quotas for project 88cc58068dc749479b723b40a455c8c3. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:39.624476 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-04bb69e0-fce3-4eaa-bd37-367eaa3d1fef tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Getting quotas for user 9e9848da15ea4ddfbceaf556423ba852 and project 88cc58068dc749479b723b40a455c8c3. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:39.845757 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:39.858207 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e7bb4806-6727-479c-ba42-aec03ed85ee2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.291402 Jun 22 09:02:39.859199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 102/212] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:39 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:39.867900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:39.868867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:39.881990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.881990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.881990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:39.882737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:39.927907 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-04bb69e0-fce3-4eaa-bd37-367eaa3d1fef tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.697012 Jun 22 09:02:39.936375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 111/213] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:02:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:40.033510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:40.041824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-592cbe65-f27c-47da-aa4d-e37ff835febf tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1218 microversion: 2.1 time: 0.180451 Jun 22 09:02:40.052070 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 103/214] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:39 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:40.260175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:40.260799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:40.271632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:40.272721 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:40.273859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:40.274553 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:40.622899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:40.635019 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:40.637240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:40.638912 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3006eb7b-f049-422c-8537-10091ef97f29 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.384197 Jun 22 09:02:40.639657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 112/215] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:40 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:40.878383 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:40.879070 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:40.885744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:40.886248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:40.887018 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:40.887451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:41.059401 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:41.060058 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:41.067571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:41.068368 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:41.069260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:41.070034 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:41.075785 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:41.084627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-59b7eff8-6101-4533-b81c-e2164eeff093 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.210811 Jun 22 09:02:41.085595 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 104/216] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:40 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:41.168494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:41.177289 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9d1204f6-1b65-4e83-8b70-e6c59825cc27 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1218 microversion: 2.1 time: 0.121638 Jun 22 09:02:41.177740 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 113/217] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:41 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:41.670705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:41.671662 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:41.682871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:41.683720 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:41.685297 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:41.688812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:41.896646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:41.910622 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:41.912450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:41.913778 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a3cd63fe-c6c1-4c83-9e70-44c8240d6cc5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.249842 Jun 22 09:02:41.914496 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 105/218] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:41 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:42.101364 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:42.101881 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:42.109199 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:42.109725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:42.121653 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:42.122208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:42.203149 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:42.205651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:42.212708 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:42.213426 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:42.218403 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:42.218403 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:42.301006 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:42.306922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:42.315169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-39eed1c2-5caf-4f8f-8b0f-834c49a7f49e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.217758 Jun 22 09:02:42.316344 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ddf63c34-489b-4f2e-a80b-cc046108f65b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1210 microversion: 2.1 time: 0.119293 Jun 22 09:02:42.316933 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 106/219] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:42 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:42.322377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 114/220] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:42 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:42.944311 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:42.944961 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:42.954545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:42.954984 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:42.955762 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:42.956202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:43.161510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:43.170533 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:43.172433 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:43.173168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6597311b-f515-4ae1-b63e-6b5e8f2d0e13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.243054 Jun 22 09:02:43.183635 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 107/221] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:42 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:43.332630 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:43.333834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:43.334328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:43.335039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:43.341354 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:43.341934 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:43.342209 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:43.342880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:43.343012 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:43.343569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:43.344196 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:43.344826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:43.466264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:43.480997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-57718914-9c75-4645-afeb-8f36b23a8974 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1266 microversion: 2.1 time: 0.150371 Jun 22 09:02:43.482571 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 108/222] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:43 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:43.545322 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:43.553851 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0ff2a90b-162f-4d19-9015-0e50c002b24f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.225199 Jun 22 09:02:43.564332 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 115/223] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:43 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:44.193955 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:44.193955 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:44.204253 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.204704 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.205469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.205900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.502969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:44.504256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:44.519318 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.519906 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.521778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.522712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.610444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:44.622268 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:44.624205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:44.631645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-68683f64-70fb-45ef-b9b4-c7e92131036a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.443325 Jun 22 09:02:44.636463 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:44.646524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 109/224] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:44 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:44.647625 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:44.648831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:44.667282 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.669127 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-32a04b21-f3f6-46a0-b85a-198404572e64 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1274 microversion: 2.1 time: 0.169922 Jun 22 09:02:44.669596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.670922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 116/225] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:44 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:44.671336 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.671887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.883900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:44.892240 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b922e18f-7a3d-42fd-b09f-6d3aa70675f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1501 microversion: 2.1 time: 0.253793 Jun 22 09:02:44.892996 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 110/226] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:44 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:44.909037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2c2d497-5eaa-45bc-bc5c-f35ef7087d9c"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:44.910168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:44.916395 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.916867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.917667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.918085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.943825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] HTTP exception thrown: Cannot 'attach_volume' instance 8d4127e9-161c-4421-ab41-0115e64e2e02 while it is in vm_state rescued Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Request method failure captured: Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: POST /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02/os-volume_attachments HTTP/1.1 Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 74 Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpESGTFaQxGtcndAFBrNLKBjja4-8WEHkQgrdwwJOcS3mOOgNl1Wt_XlYgfR-gAQ4esEgNy6I-lgmLbNqlEWaQ6B1raOj0LHh4L-H-ZidkFp5WY3reLNxIt9EqSqsyXh_ZJi0WijTJ5Ul7w36pmrdC32d1GaRA6UEsUFciKs_Ve0X4 Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:02:44.945585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}] Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: c5c6763ac1ea47da89d3bb29d630b48c Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {"volumeAttachment": {"volumeId": "b2c2d497-5eaa-45bc-bc5c-f35ef7087d9c"}} Jun 22 09:02:44.947111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Cannot 'attach_volume' instance 8d4127e9-161c-4421-ab41-0115e64e2e02 while it is in vm_state rescued Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'server_id': '8d4127e9-161c-4421-ab41-0115e64e2e02', 'body': {'volumeAttachment': {'volumeId': 'b2c2d497-5eaa-45bc-bc5c-f35ef7087d9c'}}} Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8d4127e9-161c-4421-ab41-0115e64e2e02 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:02:44.947919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8d4127e9-161c-4421-ab41-0115e64e2e02 while it is in vm_state rescued Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:02:44.949188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:02:44.950430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:02:44.950430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:02:44.950430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8d4127e9-161c-4421-ab41-0115e64e2e02 while it is in vm_state rescued Jun 22 09:02:44.950430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:02:44.950430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Returning 409 to user: Cannot 'attach_volume' instance 8d4127e9-161c-4421-ab41-0115e64e2e02 while it is in vm_state rescued {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:02:44.950430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-dd323168-983f-4a99-9a2a-e5c7fd43f3f0 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042051 Jun 22 09:02:44.951434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 117/227] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:02:44 2022] POST /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 09:02:44.959252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a9f9d8c1-6882-4aa1-b6c1-4014d65fcb2a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:44.964683 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a9f9d8c1-6882-4aa1-b6c1-4014d65fcb2a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:44.967729 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9f9d8c1-6882-4aa1-b6c1-4014d65fcb2a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.968248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9f9d8c1-6882-4aa1-b6c1-4014d65fcb2a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:44.969078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9f9d8c1-6882-4aa1-b6c1-4014d65fcb2a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:44.970149 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9f9d8c1-6882-4aa1-b6c1-4014d65fcb2a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:45.018015 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:45.231145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a9f9d8c1-6882-4aa1-b6c1-4014d65fcb2a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02/action" status: 202 len: 0 microversion: 2.1 time: 0.278165 Jun 22 09:02:45.232342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 111/228] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:02:44 2022] POST /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:02:45.241316 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:45.241915 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:45.262073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:45.262073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:45.262073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:45.262073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:45.412661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:45.421170 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-dcb089fc-949e-4dfb-8b65-c3dd7c3444be tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1509 microversion: 2.1 time: 0.183931 Jun 22 09:02:45.423902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 118/229] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:45 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:45.668707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:45.669433 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:45.676825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:45.677345 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:45.678155 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:45.678606 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:45.696443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:45.697783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:45.712114 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:45.713011 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:45.714610 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:45.715594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:45.725696 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:45.871692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:45.880232 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-14ebbb18-4c91-4de7-8c0a-2c01123adb94 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1284 microversion: 2.1 time: 0.189336 Jun 22 09:02:45.897488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 119/230] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:45 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:46.085421 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:46.101909 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:46.103675 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:46.105692 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-140376ef-8218-4da1-9296-88d1cc85b25f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.440769 Jun 22 09:02:46.106319 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 112/231] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:45 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:46.441454 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:46.442307 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:46.450444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:46.450905 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:46.451692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:46.452192 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:46.673361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:46.681177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3a3bd4bd-71fb-435b-ae05-5d970d67c62e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1509 microversion: 2.1 time: 0.244239 Jun 22 09:02:46.681807 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 120/232] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:46 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:46.904784 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:46.905959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:46.915856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:46.916855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:46.918094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:46.918692 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:47.061833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:47.069440 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ee44b875-ba0d-4bf9-9c65-70fd1b5c9aa3 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.168680 Jun 22 09:02:47.070000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 113/233] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:46 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:47.126249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:47.126986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:47.129156 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:47.134211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:47.134657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:47.135428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:47.135854 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:47.270160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:47.278306 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:47.279961 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:47.281929 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e3b248ea-5628-4215-891c-68716e579f3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.159137 Jun 22 09:02:47.282899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 121/234] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:47 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:47.705530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:47.706188 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:47.708186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:47.713414 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:47.713864 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:47.714661 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:47.715099 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:47.854347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:47.865013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-605c9aae-5be4-4c53-9dc9-002944fa3796 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1509 microversion: 2.1 time: 0.164292 Jun 22 09:02:47.865595 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 114/235] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:47 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:48.086299 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:48.086918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:48.094663 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:48.095083 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:48.095886 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:48.096327 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:48.229720 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:48.237955 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3594f79a-9b27-4c40-bd17-6b9fb1a0dc8b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.155507 Jun 22 09:02:48.238541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 122/236] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:48 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:48.301743 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:48.302406 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:48.309234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:48.309682 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:48.310498 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:48.310931 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:48.448401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:48.457673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:48.467329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:48.467329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-87df3c7b-13d4-4d0b-b125-0040000bf613 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.163798 Jun 22 09:02:48.467329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 115/237] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:48 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:48.882989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:48.883642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:48.890447 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:48.891452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:48.892242 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:48.892669 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:49.054244 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:49.076944 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-50146dc3-4bef-40bd-82d5-2ea9a8e71b0f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1509 microversion: 2.1 time: 0.197855 Jun 22 09:02:49.097211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 123/238] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:48 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:49.257534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:49.258179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:49.264120 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:49.269383 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:49.269383 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:49.269383 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:49.480356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:49.482857 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:49.496165 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:49.497228 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:49.499164 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:49.500801 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:49.640374 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=12 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:49.860821 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:49.871105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a3524fbc-555f-46d4-8e58-3add7b0e83c6 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.618568 Jun 22 09:02:49.871965 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 116/239] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:49 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:49.878016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-5d42bd07-9940-483e-9467-2fc6b94adda5 req-3c3289dd-d07e-42f6-a25b-ed6871a4e1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f6957b-adba-4998-a217-359885eee538", "tag": "2eda8cbb-79d7-4edd-8321-67815b0158a7"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:49.886889 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-5d42bd07-9940-483e-9467-2fc6b94adda5 req-3c3289dd-d07e-42f6-a25b-ed6871a4e1ae service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:49.887472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-5d42bd07-9940-483e-9467-2fc6b94adda5 req-3c3289dd-d07e-42f6-a25b-ed6871a4e1ae service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:49.903204 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-5d42bd07-9940-483e-9467-2fc6b94adda5 req-3c3289dd-d07e-42f6-a25b-ed6871a4e1ae service nova] Creating event network-changed:2eda8cbb-79d7-4edd-8321-67815b0158a7 for instance 46f6957b-adba-4998-a217-359885eee538 on hv-cinder-78729 Jun 22 09:02:49.910829 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-5d42bd07-9940-483e-9467-2fc6b94adda5 req-3c3289dd-d07e-42f6-a25b-ed6871a4e1ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037373 Jun 22 09:02:49.911440 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 117/240] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:49.927477 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:49.942285 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:49.947171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:49.951674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9794a61f-37f5-4be6-98ea-2fee96785d0f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.476483 Jun 22 09:02:49.959035 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 124/241] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:49 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:50.110750 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:50.112025 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:50.124552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:50.125855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:50.128101 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:50.129478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:50.265016 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-31133161-8d56-464b-a8a3-1d053c231612 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: .version_select at 0x7fb33290b790>, body: {"keypair": {"name": "tempest-keypair-785598927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYQ3dyDXkD7y/qRL+wTjhd03du8HgRQb/K1ogAUkU5E/KZMNpyQl00PZ1OgCJvzrUtPHPhG/NFbBvVDRJ0jhGsQa4jiJ57tM8zUD2eHavColZDUkYqWI6+VXTEUIAjizg=="}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:50.325178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-31133161-8d56-464b-a8a3-1d053c231612 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:50.333088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-31133161-8d56-464b-a8a3-1d053c231612 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:50.539945 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-31133161-8d56-464b-a8a3-1d053c231612 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.280455 Jun 22 09:02:50.555286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 125/242] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:02:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:50.602450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:50.616098 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3ab43c1c-8dfb-41a4-a69e-20af8d46abb9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1509 microversion: 2.1 time: 0.515228 Jun 22 09:02:50.618139 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 118/243] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:50 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1509 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:50.889871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:50.890172 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:50.897574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:50.898050 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:50.898855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:50.899289 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:50.978031 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:50.979609 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:50.988949 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:50.989850 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:50.990972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:50.991569 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:51.105854 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:51.115609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a34b07da-e710-45a1-b166-a552ac6d0cfd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.230697 Jun 22 09:02:51.117030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 126/244] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:50 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:51.188864 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:51.197378 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:51.199205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:51.200014 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-80af3786-4f44-456a-82ba-127c5e3f160b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.227756 Jun 22 09:02:51.200727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 119/245] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:50 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:51.639265 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:51.639919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:51.648625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:51.649064 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:51.649828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:51.650311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:51.808641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:51.817564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-13a01b15-2f14-4aff-86af-e2e920ad1f65 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1509 microversion: 2.1 time: 0.183205 Jun 22 09:02:51.818165 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 127/246] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:51 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:52.133874 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:52.134697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:52.141532 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:52.141983 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:52.142812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:52.143245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:52.219388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:52.220256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:52.227242 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:52.227868 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:52.228875 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:52.229450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:52.354105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:52.370756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9c2a703c-3197-4eab-b2b0-e7fad123676a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.240523 Jun 22 09:02:52.371460 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 120/247] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:52 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:52.467860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:52.477680 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:52.479236 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:52.480373 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e8c5c8a8-1623-4e7f-8860-0a58a09ffe7a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.265698 Jun 22 09:02:52.480964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 128/248] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:52 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:52.845627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:52.845627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:52.851723 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:52.853104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:52.854291 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:52.857496 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:52.860418 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-25b9d7f8-fe5d-4dc0-b67a-286d4dce260c req-88419cfb-9461-4cd1-87e6-31941817feaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570dea14-f80c-45cc-9935-7cf6d445d337", "name": "network-vif-plugged", "status": "completed", "tag": "be31663b-fa96-458a-8d8e-4d90d98f36db"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:52.905175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-25b9d7f8-fe5d-4dc0-b67a-286d4dce260c req-88419cfb-9461-4cd1-87e6-31941817feaf service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:52.905175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-25b9d7f8-fe5d-4dc0-b67a-286d4dce260c req-88419cfb-9461-4cd1-87e6-31941817feaf service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:52.945093 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-25b9d7f8-fe5d-4dc0-b67a-286d4dce260c req-88419cfb-9461-4cd1-87e6-31941817feaf service nova] Creating event network-vif-plugged:be31663b-fa96-458a-8d8e-4d90d98f36db for instance 570dea14-f80c-45cc-9935-7cf6d445d337 on hv-cinder-78729 Jun 22 09:02:53.012272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-25b9d7f8-fe5d-4dc0-b67a-286d4dce260c req-88419cfb-9461-4cd1-87e6-31941817feaf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120459 Jun 22 09:02:53.012272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 129/249] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:53.082443 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:53.090082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d5bbf610-b53d-4001-95a2-ab6cbf8cd3e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1509 microversion: 2.1 time: 0.258191 Jun 22 09:02:53.090686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 121/250] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:52 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:53.389903 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:53.390843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:53.414157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:53.414157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:53.414157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:53.415354 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:53.501096 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:53.501588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:53.514449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:53.515199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:53.516269 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:53.516859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:53.796446 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:53.810757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2c4956d5-c8fb-4dc6-90cd-63f8f719d3d8 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.425690 Jun 22 09:02:53.820739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 130/251] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:53 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:54.010531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:54.014528 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:54.016983 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:54.018645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e5dd9f67-1e6d-413b-af79-881f694da702 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.521724 Jun 22 09:02:54.029760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 122/252] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:53 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:54.107827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:54.111471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:54.121311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:54.122670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:54.123931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:54.124641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:54.524430 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:54.533426 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a84778c6-9a88-4d03-95fd-cf90e634c4de tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1515 microversion: 2.1 time: 0.430321 Jun 22 09:02:54.534017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 131/253] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:54 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:54.831296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:54.832035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:54.850265 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:54.852806 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:54.854198 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:54.856095 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:54.917553 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2009880047", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89fc451c-46b3-4008-9c5d-bc37135b61a8"}], "security_groups": [{"name": "tempest-securitygroup--1617553826"}], "key_name": "tempest-keypair-785598927", "user_data": "}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:55.091002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:55.094314 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] validate_networks() for [('89fc451c-46b3-4008-9c5d-bc37135b61a8', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:02:55.099056 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e8a3692d-f048-4e45-9be9-9c70ba4902ec tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.269938 Jun 22 09:02:55.100766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 123/254] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:54 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:55.111631 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:55.112554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:55.119287 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:55.130886 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:55.131875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:55.133697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:55.134474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:55.430496 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:55.446512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:55.446512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:55.452081 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-43d5170d-5d3d-4fc0-b62d-4ce089a424eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.349799 Jun 22 09:02:55.456408 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 124/255] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:55 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:55.938683 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:02:55.939168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:02:55.939600 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:02:55.940169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:02:55.940643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:02:55.953570 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:55.953570 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:55.953570 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:55.953570 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:55.971541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:55.975811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:55.978255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:55.989096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:02:55.991629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:02:56.120929 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:56.121569 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:56.129519 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:56.135586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:56.135586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:56.135586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:56.177733 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3bc34414-0c24-4348-983a-245b572930e3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.265190 Jun 22 09:02:56.178415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 132/256] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:02:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 09:02:56.207166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-69c8596b-e7f6-4e53-826a-91ae28d63acf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:56.208086 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-69c8596b-e7f6-4e53-826a-91ae28d63acf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:56.301091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-69c8596b-e7f6-4e53-826a-91ae28d63acf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:56.310049 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-69c8596b-e7f6-4e53-826a-91ae28d63acf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1241 microversion: 2.1 time: 0.119728 Jun 22 09:02:56.314742 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 133/257] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:56 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:56.366825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:56.392143 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1cea4a98-6399-45ba-ada2-c24d7b6797e5 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.275250 Jun 22 09:02:56.392881 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 125/258] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:56 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:56.475409 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:56.476026 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:56.483030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:56.483516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:56.484990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:56.485698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:56.701092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:56.713730 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:56.715843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:56.730561 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-adf9be7f-dc57-4c68-8fcb-116650563bbc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.247099 Jun 22 09:02:56.730561 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 134/259] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:56 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:57.334484 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:57.335160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:57.342872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:57.343743 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:57.345079 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:57.345507 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:57.410279 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:57.412898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:57.418658 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:57.425649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:57.426741 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:57.426950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-005652a7-c47d-442d-9b94-f88c0145e7b1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1245 microversion: 2.1 time: 0.097072 Jun 22 09:02:57.428522 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:57.429414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:57.436134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 126/260] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:57 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1245 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:57.593217 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:57.603183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-de49430c-0e09-4e1e-9c3d-e73d1fdafe4e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.196738 Jun 22 09:02:57.603888 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 135/261] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:57 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:57.743155 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:57.744474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:57.754366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:57.754989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:57.756379 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:57.757068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:57.973508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:57.985041 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:57.988010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:57.990170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-45b65f64-43b5-4bca-9485-2aa4888abc68 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.253983 Jun 22 09:02:57.991171 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 127/262] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:57 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:02:58.443766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:58.444710 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:58.455702 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:58.456420 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:58.457671 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:58.458491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:58.564229 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:58.575887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-90ee05bc-8de0-4930-aa62-50b0f714008d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1237 microversion: 2.1 time: 0.136247 Jun 22 09:02:58.586107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 136/263] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:58 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1237 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:58.623688 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:58.624707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:58.632150 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:58.632630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:58.633478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:58.634188 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:58.752273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-954250e7-7cb1-4e99-9242-dab0192a15ef tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'create', calling method: .version_select at 0x7fb332977ee0>, body: {"keypair": {"name": "tempest-keypair-1841289564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWA6rqFk6D1GSq8h4JJq67D3evwugW2Mm34PBWPklkhimnjm+4dnN5ed7ED+QSN+x+fv5KVtgHr0wHPiMDny0l+uHdKTiS0tJ2RP1QI0I9VWykhbHPRTckTANT2g7Emcw=="}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:58.775281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-954250e7-7cb1-4e99-9242-dab0192a15ef tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:02:58.783456 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-954250e7-7cb1-4e99-9242-dab0192a15ef tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for user c5c6763ac1ea47da89d3bb29d630b48c and project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:02:58.805502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:58.941159 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:58.948993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ccf267be-66b8-4fb1-ae90-05942648fe08 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.331871 Jun 22 09:02:58.950086 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 128/264] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:58 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:02:58.966429 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-954250e7-7cb1-4e99-9242-dab0192a15ef tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.220913 Jun 22 09:02:58.990102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 137/265] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:02:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:59.013081 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:59.013683 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:59.020495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:59.021011 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:59.021736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:59.022205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:59.177029 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:59.202254 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:59.204883 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:59.206574 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-60706bc4-5844-4521-a85b-7d41ed409062 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1405 microversion: 2.20 time: 0.197290 Jun 22 09:02:59.207145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 129/266] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:02:59 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:02:59.605921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:59.606827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:59.623121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:59.623717 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:59.625582 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:59.626657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:59.702006 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:02:59.711511 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fdd1d1b0-75fa-4b38-bbe0-d7565c039eb3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1293 microversion: 2.1 time: 0.109748 Jun 22 09:02:59.712294 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 138/267] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:59 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:02:59.919866 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-64bcf746-185e-4bae-b73f-1d67e4ee95cc req-682a885f-ded8-4d31-a8fc-6a0306ca3e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f6957b-adba-4998-a217-359885eee538", "name": "network-vif-plugged", "status": "completed", "tag": "2eda8cbb-79d7-4edd-8321-67815b0158a7"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:02:59.934662 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-64bcf746-185e-4bae-b73f-1d67e4ee95cc req-682a885f-ded8-4d31-a8fc-6a0306ca3e1e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:59.935267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-64bcf746-185e-4bae-b73f-1d67e4ee95cc req-682a885f-ded8-4d31-a8fc-6a0306ca3e1e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:59.948912 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-64bcf746-185e-4bae-b73f-1d67e4ee95cc req-682a885f-ded8-4d31-a8fc-6a0306ca3e1e service nova] Creating event network-vif-plugged:2eda8cbb-79d7-4edd-8321-67815b0158a7 for instance 46f6957b-adba-4998-a217-359885eee538 on hv-cinder-78729 Jun 22 09:02:59.957131 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-64bcf746-185e-4bae-b73f-1d67e4ee95cc req-682a885f-ded8-4d31-a8fc-6a0306ca3e1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044964 Jun 22 09:02:59.958097 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 130/268] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:02:59.980339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:02:59.981451 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:02:59.992644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:59.993110 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:02:59.994351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:02:59.995325 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:00.283463 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:00.284940 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:00.351082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:00.351889 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:00.353346 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:00.362975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:00.650762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:00.661168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3e0214dc-567b-4b7a-a831-30f49d3b351b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.687092 Jun 22 09:03:00.674469 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 139/269] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:02:59 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:00.733605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:00.735260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:00.748053 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:00.748756 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:00.750878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:00.751672 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:00.759938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:00.982747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:00.991762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ae898a04-fbe1-47c4-a71c-5fcad7ecac15 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1299 microversion: 2.1 time: 0.265633 Jun 22 09:03:01.002281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 140/270] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:00 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:01.002615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:01.004524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:01.006101 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:01.007369 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5037ef13-001f-4cde-8139-9662a5aeee90 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1597 microversion: 2.20 time: 0.760968 Jun 22 09:03:01.007911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 131/271] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:03:00 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1597 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:03:01.026796 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-cd4c51a3-d6f1-47ba-9cf7-0bbabecd84ab tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:01.027308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-cd4c51a3-d6f1-47ba-9cf7-0bbabecd84ab tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:01.034357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cd4c51a3-d6f1-47ba-9cf7-0bbabecd84ab tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:01.034810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cd4c51a3-d6f1-47ba-9cf7-0bbabecd84ab tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:01.035583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cd4c51a3-d6f1-47ba-9cf7-0bbabecd84ab tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:01.036017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cd4c51a3-d6f1-47ba-9cf7-0bbabecd84ab tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:01.135323 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-cd4c51a3-d6f1-47ba-9cf7-0bbabecd84ab tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112936 Jun 22 09:03:01.135923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 141/272] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Jun 22 09:03:01 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:03:01.689845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:01.691421 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:01.699140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:01.699690 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:01.700553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:01.701236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:02.016392 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:02.017804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:02.026947 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:02.027890 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:02.028925 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:02.029564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:02.157784 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:02.165357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c38c7798-4526-44c7-944f-9c8ccd281a0c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1299 microversion: 2.1 time: 0.154492 Jun 22 09:03:02.166864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 142/273] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:02 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:02.292159 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:02.304256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fab9bd8a-a118-446d-b499-9f856b71137c tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.621251 Jun 22 09:03:02.305118 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 132/274] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:01 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:03.140997 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-10862472", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81450ca5-339e-4f08-bdc8-ec0a189d1628"}], "security_groups": [{"name": "tempest-securitygroup--1660045528"}], "key_name": "tempest-keypair-1841289564", "user_data": "}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:03.185638 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:03.186425 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:03.206783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:03.207323 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:03.208194 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:03.208879 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:03.384831 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] validate_networks() for [('81450ca5-339e-4f08-bdc8-ec0a189d1628', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:03:03.559695 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:03.569547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a4538935-27b1-43b5-b24e-5e8991f23555 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.388869 Jun 22 09:03:03.578177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 133/275] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:03 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:03.578177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:03.578177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:03.591225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:03.591225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:03.591225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:03.591225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:03.850971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:03.862579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b4ee28e6-585c-49a4-8b02-31240d241751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.290819 Jun 22 09:03:03.863770 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 134/276] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:03 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:03.868558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-22ce7c13-2d23-421b-a139-0d8d18b97993 req-438bd6a9-f56b-46e5-9ff1-34111dd287df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570dea14-f80c-45cc-9935-7cf6d445d337", "tag": "be31663b-fa96-458a-8d8e-4d90d98f36db"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:03.877858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-22ce7c13-2d23-421b-a139-0d8d18b97993 req-438bd6a9-f56b-46e5-9ff1-34111dd287df service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:03.878569 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-22ce7c13-2d23-421b-a139-0d8d18b97993 req-438bd6a9-f56b-46e5-9ff1-34111dd287df service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:03.891510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-22ce7c13-2d23-421b-a139-0d8d18b97993 req-438bd6a9-f56b-46e5-9ff1-34111dd287df service nova] Creating event network-changed:be31663b-fa96-458a-8d8e-4d90d98f36db for instance 570dea14-f80c-45cc-9935-7cf6d445d337 on hv-cinder-78729 Jun 22 09:03:03.900475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-22ce7c13-2d23-421b-a139-0d8d18b97993 req-438bd6a9-f56b-46e5-9ff1-34111dd287df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035266 Jun 22 09:03:03.901411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 135/277] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:04.032297 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:03:04.033323 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:03:04.034006 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:03:04.034573 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:03:04.035166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:03:04.058160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:04.058160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:04.058160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:04.058160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:04.065786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:03:04.069708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Getting quotas for user c5c6763ac1ea47da89d3bb29d630b48c and project d20fd7bac1c94a908fd293fa82c534dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:03:04.081592 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:03:04.083773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:03:04.298451 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d2bb3e39-82d4-4bf8-855d-9feabf3fce39 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.162249 Jun 22 09:03:04.299212 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 143/278] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:03:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:03:04.310097 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3a673afb-e19f-4334-95fb-8439588f126b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:04.311219 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3a673afb-e19f-4334-95fb-8439588f126b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:04.384655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3a673afb-e19f-4334-95fb-8439588f126b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:04.398987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3a673afb-e19f-4334-95fb-8439588f126b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1244 microversion: 2.1 time: 0.093190 Jun 22 09:03:04.400064 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 136/279] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:04 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:04.588820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:04.589580 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:04.601360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:04.602087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:04.603056 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:04.603650 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:04.772172 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:04.783052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-dc62ecbb-f2fa-4e04-8991-d290b09dc795 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.198125 Jun 22 09:03:04.784113 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 144/280] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:04 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:04.881159 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:04.882046 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:04.889780 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:04.890378 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:04.891261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:04.891776 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:05.042135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:05.050340 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-66d500f7-4211-4ea6-9d97-68b80f1d4d05 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1314 microversion: 2.1 time: 0.173841 Jun 22 09:03:05.050903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 137/281] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:04 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:05.417291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8eae46a7-8ebf-4121-bc53-be1ea3b9bdd6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:05.418186 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8eae46a7-8ebf-4121-bc53-be1ea3b9bdd6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:05.541483 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8eae46a7-8ebf-4121-bc53-be1ea3b9bdd6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:05.553800 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8eae46a7-8ebf-4121-bc53-be1ea3b9bdd6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1244 microversion: 2.1 time: 0.139983 Jun 22 09:03:05.554974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 145/282] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:05 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1244 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:05.801087 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:05.801725 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:05.808090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:05.808464 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:05.809280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:05.809715 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:06.037410 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:06.045595 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6ea9e8f3-cb83-4fae-b020-ba8088830bf0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.248387 Jun 22 09:03:06.051511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 138/283] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:05 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:06.068885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:06.069422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:06.091661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:06.092025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:06.093373 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:06.093817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:06.317878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-fff35368-bca2-441e-b157-85dde0b82d27 req-bedbecab-b469-4c4f-8e95-807323f9358f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3f60b3-c6b7-473b-97a3-a83de42be721", "tag": "58aea969-8187-49bf-85e8-f39697542c80"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:06.339946 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-fff35368-bca2-441e-b157-85dde0b82d27 req-bedbecab-b469-4c4f-8e95-807323f9358f service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:06.340738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-fff35368-bca2-441e-b157-85dde0b82d27 req-bedbecab-b469-4c4f-8e95-807323f9358f service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:06.361808 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-fff35368-bca2-441e-b157-85dde0b82d27 req-bedbecab-b469-4c4f-8e95-807323f9358f service nova] Creating event network-changed:58aea969-8187-49bf-85e8-f39697542c80 for instance cb3f60b3-c6b7-473b-97a3-a83de42be721 on hv-cinder-78729 Jun 22 09:03:06.372026 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-fff35368-bca2-441e-b157-85dde0b82d27 req-bedbecab-b469-4c4f-8e95-807323f9358f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057677 Jun 22 09:03:06.373573 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 139/284] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:03:06.582077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:06.582789 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:06.589569 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:06.591105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:06.591539 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:06.591968 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:06.613943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:06.634417 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3892845a-cec7-4098-9fe8-6dc16c554114 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1499 microversion: 2.1 time: 0.559051 Jun 22 09:03:06.634417 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 146/285] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:06 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1499 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:07.008576 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:07.018783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-565e8038-e312-40fd-85d6-1bc725268a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1240 microversion: 2.1 time: 0.449555 Jun 22 09:03:07.019374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 140/286] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:06 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1240 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:07.068815 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:07.069457 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:07.080293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:07.080293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:07.080293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:07.080293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:07.303138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:07.303138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-85a765f7-5a92-40c6-b184-a2fad78ca3ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.223567 Jun 22 09:03:07.303138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 147/287] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:07 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:08.036819 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:08.037576 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:08.044882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.045355 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:08.046677 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.047402 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:08.160830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:08.182701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-456010ca-7b7c-46a3-be56-1c8e35e507ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1304 microversion: 2.1 time: 0.149745 Jun 22 09:03:08.183950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 141/288] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:08 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:08.319781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:08.320404 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:08.335195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.336678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:08.337494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.338823 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:08.428988 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:08.429292 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:08.435801 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.436257 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:08.437676 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.438126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:08.465554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:03:08.564250 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:08.585310 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-07f3e80c-6b8a-493c-a0a5-1d1a89cd2194 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.271578 Jun 22 09:03:08.600139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 148/289] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:08 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:08.882876 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-bd29e9fb-22ae-4f06-8fe0-d711ab6600fb tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "DELETE /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 204 len: 0 microversion: 2.1 time: 0.457518 Jun 22 09:03:08.884458 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 142/290] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:03:08 2022] DELETE /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:03:08.893074 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:08.893969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:08.902239 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.902698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:08.903484 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:08.903948 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:09.113037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:09.120746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4d8f5fc5-ed77-4651-aa4b-1ffe1a7aaa8d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1505 microversion: 2.1 time: 0.231792 Jun 22 09:03:09.134534 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 149/291] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:08 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:09.202914 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:09.203772 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:09.211644 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:09.212287 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:09.213805 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:09.214646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:09.454897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:09.463757 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e47ee4e4-db4d-4fa4-8d52-fa3769830143 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1382 microversion: 2.1 time: 0.266148 Jun 22 09:03:09.464336 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 143/292] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:09 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1382 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:09.607952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:09.610028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:09.616692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:09.617137 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:09.617921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:09.618617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:09.851090 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:09.869043 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-43d5de18-0234-4546-a314-9b9e3219de70 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.265860 Jun 22 09:03:09.880925 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 150/293] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:09 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:10.141163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:10.141998 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:10.150348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:10.150901 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:10.151781 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:10.152296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:10.412507 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:10.430226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2944145a-8595-4000-98fa-4a99e727e6e1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1505 microversion: 2.1 time: 0.293778 Jun 22 09:03:10.441265 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 144/294] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:10 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:10.482976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:10.484948 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:10.492003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:10.492630 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:10.493510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:10.494368 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:10.850796 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:10.862180 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f4db10ea-7a51-4a78-abe6-92ef3b08c83c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.383130 Jun 22 09:03:10.864691 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 151/295] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:10 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:10.890495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:10.890495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:10.896753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:10.897202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:10.897972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:10.898438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:11.054357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-764633a2-d90d-429f-8a6d-02aa131fa359 req-9d322659-8042-44a8-a1a0-52bd8c211182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0bc5af-2a76-4d82-a1c4-fba8eac05dba", "tag": "9245704a-8d26-4a4c-af84-7c9cacbb258e"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:11.072218 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-764633a2-d90d-429f-8a6d-02aa131fa359 req-9d322659-8042-44a8-a1a0-52bd8c211182 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:11.073265 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-764633a2-d90d-429f-8a6d-02aa131fa359 req-9d322659-8042-44a8-a1a0-52bd8c211182 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:11.090774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-764633a2-d90d-429f-8a6d-02aa131fa359 req-9d322659-8042-44a8-a1a0-52bd8c211182 service nova] Creating event network-changed:9245704a-8d26-4a4c-af84-7c9cacbb258e for instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba on hv-cinder-78729 Jun 22 09:03:11.096962 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-764633a2-d90d-429f-8a6d-02aa131fa359 req-9d322659-8042-44a8-a1a0-52bd8c211182 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046402 Jun 22 09:03:11.098245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 152/296] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:03:11.112811 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:11.121054 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-250e34b9-46b5-42df-b132-9724230f80ff tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.235679 Jun 22 09:03:11.122013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 145/297] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:10 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:11.448175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:11.449023 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:11.456462 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:11.456913 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:11.457688 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:11.458202 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:11.687328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:11.700320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fdfe6c33-712b-4a70-a2af-2fad396d4dfe tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1505 microversion: 2.1 time: 0.256289 Jun 22 09:03:11.700902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 153/298] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:11 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:11.890435 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:11.891298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:11.898873 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:11.899753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:11.900705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:11.902020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:11.927307 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:12.149923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:12.151135 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:12.163078 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:12.163913 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:12.165273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:12.165931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:12.277911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:12.286223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-406087b3-f177-4499-83b9-0cd6699fa19c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.400225 Jun 22 09:03:12.286810 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 146/299] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:11 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:12.520314 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:12.534168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bdece511-a816-46bc-b4d2-7fdbf4f5daaf tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.388777 Jun 22 09:03:12.545484 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 154/300] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:12 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:12.724115 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:12.729254 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:12.750347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:12.759631 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:12.768528 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:12.769262 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:12.901601 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1666067514", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1316151461", "security_groups": [{"name": "tempest-secgroup-smoke-613429955"}], "networks": [{"uuid": "4df2dd48-6f93-4c9d-94e5-26ba102bb6e6"}], "block_device_mapping_v2": [{"uuid": "89b8fb39-c3e5-4516-8ee9-c669fe4025a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:12.908024 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:12.920342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1467bd8d-0725-4100-a801-1d03bb876d99 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1463 microversion: 2.1 time: 0.201952 Jun 22 09:03:12.921882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 147/301] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:12 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:13.128073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-cd9a427a-0211-4627-9937-8f1de456ce8e req-af014ef9-3341-4723-b202-17ffa178b6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f6957b-adba-4998-a217-359885eee538", "name": "network-vif-deleted", "tag": "2eda8cbb-79d7-4edd-8321-67815b0158a7"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:13.134193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] validate_networks() for [('4df2dd48-6f93-4c9d-94e5-26ba102bb6e6', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:03:13.144127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-cd9a427a-0211-4627-9937-8f1de456ce8e req-af014ef9-3341-4723-b202-17ffa178b6f3 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:13.145035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-cd9a427a-0211-4627-9937-8f1de456ce8e req-af014ef9-3341-4723-b202-17ffa178b6f3 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:13.172976 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-cd9a427a-0211-4627-9937-8f1de456ce8e req-af014ef9-3341-4723-b202-17ffa178b6f3 service nova] Creating event network-vif-deleted:2eda8cbb-79d7-4edd-8321-67815b0158a7 for instance 46f6957b-adba-4998-a217-359885eee538 on hv-cinder-78729 Jun 22 09:03:13.180195 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-cd9a427a-0211-4627-9937-8f1de456ce8e req-af014ef9-3341-4723-b202-17ffa178b6f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059957 Jun 22 09:03:13.181338 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 148/302] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:13.303889 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:13.304702 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:13.316205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:13.317054 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:13.318004 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:13.318616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:13.630935 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:13.644355 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ef88c346-a98c-4cd3-91f5-8c2414cc55c3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.344380 Jun 22 09:03:13.650251 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 149/303] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:13 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:13.657455 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:13.658546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:13.669035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:13.669815 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:13.680123 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:13.680123 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.057361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:14.096824 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:03:14.097355 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:03:14.097795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:03:14.098649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:03:14.099078 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:03:14.111091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:14.111605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.112332 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:14.112765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.133780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Getting quotas for project 88cc58068dc749479b723b40a455c8c3. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:03:14.138780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Getting quotas for user 9e9848da15ea4ddfbceaf556423ba852 and project 88cc58068dc749479b723b40a455c8c3. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:03:14.149121 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:14.172129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d4a5f59b-8a59-40c5-b79c-25f5bf77918d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.524806 Jun 22 09:03:14.173868 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 150/304] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:13 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:14.179558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:14.180089 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:14.188677 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:14.189133 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.189972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:14.190442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.203963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:03:14.206147 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89b8fb39-c3e5-4516-8ee9-c669fe4025a5',volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:03:14.226759 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:14.227211 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.227675 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lazy-loading 'fault' on Instance uuid 46f6957b-adba-4998-a217-359885eee538 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:03:14.273970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:14.281913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fcea3ad0-db88-47e7-b426-40b1ca59227f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 200 len: 1304 microversion: 2.1 time: 0.106612 Jun 22 09:03:14.282542 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 151/305] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:14 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:14.663629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:14.664099 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:14.666013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:14.672119 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:14.672563 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.673330 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:14.673795 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:14.828022 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8b326773-d48f-4f39-a196-45e19ae6aad1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.931768 Jun 22 09:03:14.828680 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 155/306] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:03:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:03:14.845039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f15e5e58-dbfa-44b1-9b87-73c2f51f7d81 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:14.845916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f15e5e58-dbfa-44b1-9b87-73c2f51f7d81 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:14.854414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:14.860563 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:14.878290 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d764543d-a83a-4a8d-b196-e00c5e5e4d0d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.218294 Jun 22 09:03:14.878933 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 152/307] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:14 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:14.926281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f15e5e58-dbfa-44b1-9b87-73c2f51f7d81 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:14.935177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f15e5e58-dbfa-44b1-9b87-73c2f51f7d81 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1089 microversion: 2.1 time: 0.098606 Jun 22 09:03:14.945471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 156/308] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:14 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:15.155243 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-f711ab09-c028-48b4-80aa-062f456256eb req-d5d24b2b-76d4-443e-9571-82aa54d06f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3f60b3-c6b7-473b-97a3-a83de42be721", "name": "network-vif-plugged", "status": "completed", "tag": "58aea969-8187-49bf-85e8-f39697542c80"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:15.164571 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-f711ab09-c028-48b4-80aa-062f456256eb req-d5d24b2b-76d4-443e-9571-82aa54d06f21 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:15.165010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-f711ab09-c028-48b4-80aa-062f456256eb req-d5d24b2b-76d4-443e-9571-82aa54d06f21 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:15.190023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-f711ab09-c028-48b4-80aa-062f456256eb req-d5d24b2b-76d4-443e-9571-82aa54d06f21 service nova] Creating event network-vif-plugged:58aea969-8187-49bf-85e8-f39697542c80 for instance cb3f60b3-c6b7-473b-97a3-a83de42be721 on hv-cinder-78729 Jun 22 09:03:15.190023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-f711ab09-c028-48b4-80aa-062f456256eb req-d5d24b2b-76d4-443e-9571-82aa54d06f21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031006 Jun 22 09:03:15.190023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 153/309] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:15.193081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:15.193692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:15.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:15.200989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:15.201804 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:15.202770 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:15.304759 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:15.305719 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: 46f6957b-adba-4998-a217-359885eee538] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:15.314783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:15.315579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:15.316944 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:15.317803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:15.335869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] HTTP exception thrown: Instance 46f6957b-adba-4998-a217-359885eee538 could not be found. Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Request method failure captured: Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 HTTP/1.1 Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistqoPM-4lfd0pJWSj4ld5dMxZwfXpx_w2jPVrGU77OwhE1ke7mBepZyqL5AbcaZK74U_2exXKV2il1nM9BZ8XzGYsptNf2vibT1wSw3HRyT02gMWecsitPumOhwy08DnYaYAi9FZeNjJ5BP1felYqc9PbITiKinF--r4wOdvRM80aTo Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 9beb16c610a94371b896183858e4c1d5 Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesActionsTest-1395454310 Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:03:15.337546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9beb16c610a94371b896183858e4c1d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9beb16c610a94371b896183858e4c1d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9beb16c610a94371b896183858e4c1d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9beb16c610a94371b896183858e4c1d5"}]}] Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesActionsTest-1395454310 Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 9beb16c610a94371b896183858e4c1d5 Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesActionsTest-1395454310 Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesActionsTest-1395454310-project Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: e4eae42e04bd49ecae3fd63cd5b52a43 Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesActionsTest-1395454310-project Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 46f6957b-adba-4998-a217-359885eee538 could not be found. Jun 22 09:03:15.339520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '46f6957b-adba-4998-a217-359885eee538'} Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f6957b-adba-4998-a217-359885eee538 could not be found. Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:03:15.341301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f6957b-adba-4998-a217-359885eee538 could not be found. Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f6957b-adba-4998-a217-359885eee538 could not be found. Jun 22 09:03:15.344321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:15.346855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Returning 404 to user: Instance 46f6957b-adba-4998-a217-359885eee538 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:03:15.346855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-35a2132f-a666-4077-97ba-aea105c98751 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538" status: 404 len: 111 microversion: 2.1 time: 0.043477 Jun 22 09:03:15.346855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 154/310] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:15 2022] GET /compute/v2.1/servers/46f6957b-adba-4998-a217-359885eee538 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:03:15.442674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:15.456351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-483eb05b-e0cf-4b18-a656-fb9b29fc0e34 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.267926 Jun 22 09:03:15.459433 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 157/311] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:15 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:15.527297 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-199502497", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "networks": [{"uuid": "2af2e494-609c-486f-90c0-df3b055f7328"}]}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:15.609620 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] validate_networks() for [('2af2e494-609c-486f-90c0-df3b055f7328', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:03:15.896965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:15.897794 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:15.905784 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:15.907194 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:15.908191 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:15.908783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:16.217207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:16.227861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-06252c42-83a2-4656-b83a-36d0c6e9ef66 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.334722 Jun 22 09:03:16.228855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 158/312] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:15 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:16.243735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4c3d604e-0d2e-4e69-b365-baaa6d3252cf tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:16.244600 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4c3d604e-0d2e-4e69-b365-baaa6d3252cf tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:16.256249 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:03:16.257550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:03:16.258411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:03:16.258830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:03:16.259617 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:03:16.272059 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:16.272767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:16.274096 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:16.274795 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:16.299038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Getting quotas for project 9beb16c610a94371b896183858e4c1d5. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:03:16.305412 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Getting quotas for user e4eae42e04bd49ecae3fd63cd5b52a43 and project 9beb16c610a94371b896183858e4c1d5. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:03:16.320975 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4c3d604e-0d2e-4e69-b365-baaa6d3252cf tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:16.322272 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:03:16.326198 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:03:16.331089 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4c3d604e-0d2e-4e69-b365-baaa6d3252cf tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1089 microversion: 2.1 time: 0.091130 Jun 22 09:03:16.332500 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 159/313] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:16 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1089 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:16.476016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8a44d61f-a8b3-4139-bd86-ad5e715a3cff tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952409 Jun 22 09:03:16.478218 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:16.478373 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:16.478710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 155/314] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:03:16.491930 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:16.492420 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:16.493299 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:16.494043 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:16.494390 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2321f822-64cf-46d8-be38-94eadf6bfcbd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:16.495200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2321f822-64cf-46d8-be38-94eadf6bfcbd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:16.573337 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2321f822-64cf-46d8-be38-94eadf6bfcbd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:16.585228 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2321f822-64cf-46d8-be38-94eadf6bfcbd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1213 microversion: 2.1 time: 0.095826 Jun 22 09:03:16.586441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 156/315] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:16 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:16.747473 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:16.769574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5f74979c-46f7-4562-82a8-1e917d0f46a4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.299759 Jun 22 09:03:16.772119 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 160/316] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:16 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:17.246122 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:17.246782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:17.253641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.255186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.255186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.255744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.366259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:17.367015 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:17.386676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.387754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.390680 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.391151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.470956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:17.483172 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2240fc0f-41c1-4496-95b2-ba23f5a61cfa tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.240734 Jun 22 09:03:17.495638 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 157/317] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:17 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:17.498274 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:17.508072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-48bda780-c1cb-4cfe-b302-0446cea0bba5 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1139 microversion: 2.1 time: 0.152462 Jun 22 09:03:17.513314 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 161/318] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:17 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1139 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:17.618050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:17.621207 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:17.636013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.637747 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.663326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.663784 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.755954 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:17.763757 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-108c3c53-68be-497c-a9d2-69c4c478333b tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1217 microversion: 2.1 time: 0.155067 Jun 22 09:03:17.764359 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 158/319] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:17 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:17.821277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:17.821909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:17.828789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.829248 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.830107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:17.830551 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:17.834833 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:17.978156 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:17.986790 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b54cbab8-c963-4ca5-a74d-511e937f9238 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.169559 Jun 22 09:03:17.987374 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 162/320] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:17 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:18.503244 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:18.503860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:18.510939 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.511391 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.512489 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.512611 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.541562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:18.541562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:18.545774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.547807 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.548749 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.549610 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.624513 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:18.639129 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2761c4bf-a3ac-4c22-a512-171f0de78374 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1139 microversion: 2.1 time: 0.112969 Jun 22 09:03:18.639725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 163/321] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:18 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1139 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:18.687404 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:18.695138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0077db14-b98b-4e2d-b52b-1b25e341ddb8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.196433 Jun 22 09:03:18.695706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 159/322] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:18 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:18.780976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:18.781591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:18.787814 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.788259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.789022 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:18.789454 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:18.858811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:18.867345 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-69f926d8-17a2-4397-bb8c-ead5af68a739 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1217 microversion: 2.1 time: 0.090061 Jun 22 09:03:18.868082 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 164/323] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:18 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:19.004044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:19.004659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:19.010862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.011312 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.012086 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.012523 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.158617 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:19.166039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e53e1789-129c-40d4-81f3-65e8509bbe9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.165897 Jun 22 09:03:19.166611 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 160/324] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:18 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:19.657912 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:19.658515 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:19.665226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.665678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.666488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.666917 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.711269 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:19.711871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:19.715746 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:19.719751 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.720191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.720975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.721409 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.752607 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:19.761081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b596b2ec-04b9-4e8e-b861-d97e3f84bd28 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1131 microversion: 2.1 time: 0.108071 Jun 22 09:03:19.761687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 165/325] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:19 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1131 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:19.885693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:19.886827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:19.889978 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:19.893163 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.893697 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.894707 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:19.895161 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:19.916237 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e9d3e46f-1bd1-490a-aeb7-61b3d0d341cc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.208212 Jun 22 09:03:19.917501 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 161/326] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:19 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:19.993892 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:20.006396 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3dfde581-13f9-4eba-8e03-1026146e2868 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1209 microversion: 2.1 time: 0.124661 Jun 22 09:03:20.007240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 166/327] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:19 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:20.185366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:20.186172 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:20.193882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:20.196329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:20.196329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:20.196329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:20.343063 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:20.351508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f9b2df1a-41e1-4849-a146-c8f1005b8a9b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1367 microversion: 2.1 time: 0.172150 Jun 22 09:03:20.352383 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 162/328] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:20 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:20.781813 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:20.782708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:20.791060 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:20.791515 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:20.792335 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:20.792774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:20.876357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:20.884221 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9016d9f6-9814-47bf-ad25-2e2c23cb3cd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1187 microversion: 2.1 time: 0.107039 Jun 22 09:03:20.884789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 167/329] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:20 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:20.936864 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:20.937490 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:20.943900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:20.944348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:20.945121 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:20.945744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.023068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:21.023671 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:21.035668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.036178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.036953 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.037384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.177530 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:21.185819 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-78b2142b-875f-4438-bcae-baec3322d07e tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1265 microversion: 2.1 time: 0.166475 Jun 22 09:03:21.186736 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 168/330] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:21 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:21.200803 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-a9276df6-c8ec-46c1-994b-e3731c178dfd req-cd6fd1e3-64b7-45da-8855-8243d6ae3169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0bc5af-2a76-4d82-a1c4-fba8eac05dba", "name": "network-vif-plugged", "status": "completed", "tag": "9245704a-8d26-4a4c-af84-7c9cacbb258e"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:21.219606 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-a9276df6-c8ec-46c1-994b-e3731c178dfd req-cd6fd1e3-64b7-45da-8855-8243d6ae3169 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.219606 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-a9276df6-c8ec-46c1-994b-e3731c178dfd req-cd6fd1e3-64b7-45da-8855-8243d6ae3169 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.219791 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:21.228436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4f8178c6-1960-4b79-a947-b42535d96f6b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.295921 Jun 22 09:03:21.235890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 163/331] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:20 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:21.247486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-a9276df6-c8ec-46c1-994b-e3731c178dfd req-cd6fd1e3-64b7-45da-8855-8243d6ae3169 service nova] Creating event network-vif-plugged:9245704a-8d26-4a4c-af84-7c9cacbb258e for instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba on hv-cinder-78729 Jun 22 09:03:21.260970 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-a9276df6-c8ec-46c1-994b-e3731c178dfd req-cd6fd1e3-64b7-45da-8855-8243d6ae3169 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063726 Jun 22 09:03:21.261916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 169/332] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:21.369768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:21.378677 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:21.378812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.379161 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.379946 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.380609 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.654760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:21.664372 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7e4f76f2-1839-4269-b09e-736d38a2ecce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1556 microversion: 2.1 time: 0.298650 Jun 22 09:03:21.665013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 164/333] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:21 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1556 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:21.682100 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-adcb2a52-688b-46ae-8089-015b3bca907c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:21.682815 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-adcb2a52-688b-46ae-8089-015b3bca907c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:21.692679 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adcb2a52-688b-46ae-8089-015b3bca907c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.695943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adcb2a52-688b-46ae-8089-015b3bca907c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.696133 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adcb2a52-688b-46ae-8089-015b3bca907c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.697005 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-adcb2a52-688b-46ae-8089-015b3bca907c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.902238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:21.903177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:21.910023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.910572 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.911349 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:21.911780 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:21.940997 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-adcb2a52-688b-46ae-8089-015b3bca907c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263099 Jun 22 09:03:21.941880 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 170/334] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:03:21 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:22.050681 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:22.065983 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-881be16a-b377-4b97-ba8a-0172e7b294c6 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1205 microversion: 2.1 time: 0.168816 Jun 22 09:03:22.069641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 165/335] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:21 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1205 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:22.205860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:22.207056 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:22.216319 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:22.216776 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:22.218298 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:22.218739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:22.254629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:22.255327 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:22.265511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:22.268671 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:22.269852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:22.274672 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:22.299427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:22.317978 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:22.330783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6c4cd2e3-f78a-4896-ab0b-3cbd89f5dbcc tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1271 microversion: 2.1 time: 0.130911 Jun 22 09:03:22.331142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:22 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:22.625789 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:22.634436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ecff40d5-8b14-462e-8277-9d3796b767c9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.385777 Jun 22 09:03:22.635014 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 166/337] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:22 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:23.089632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:23.090989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:23.100739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:23.101541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:23.102798 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:23.103399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:23.351058 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:23.352753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:23.362648 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:23.363231 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:23.364079 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:23.364801 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:23.517158 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:23.531242 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c33b761d-f98f-4bce-84d3-160d2f829955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1272 microversion: 2.1 time: 0.445795 Jun 22 09:03:23.532183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 172/338] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:23 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1272 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:23.551927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-48521b82-996d-44e0-a632-c86c44c00c0c req-4a4fd537-6fd5-473c-b696-7a6fc8ae3c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3f60b3-c6b7-473b-97a3-a83de42be721", "tag": "58aea969-8187-49bf-85e8-f39697542c80"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:23.569368 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-48521b82-996d-44e0-a632-c86c44c00c0c req-4a4fd537-6fd5-473c-b696-7a6fc8ae3c32 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:23.569826 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-48521b82-996d-44e0-a632-c86c44c00c0c req-4a4fd537-6fd5-473c-b696-7a6fc8ae3c32 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:23.590994 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-48521b82-996d-44e0-a632-c86c44c00c0c req-4a4fd537-6fd5-473c-b696-7a6fc8ae3c32 service nova] Creating event network-changed:58aea969-8187-49bf-85e8-f39697542c80 for instance cb3f60b3-c6b7-473b-97a3-a83de42be721 on hv-cinder-78729 Jun 22 09:03:23.598632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-48521b82-996d-44e0-a632-c86c44c00c0c req-4a4fd537-6fd5-473c-b696-7a6fc8ae3c32 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050299 Jun 22 09:03:23.617312 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 173/339] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:03:23.652887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:23.657038 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:23.660918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:23.661391 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:23.662297 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:23.662930 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:23.744223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:23.752982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f8257f60-c23b-47a6-9597-29197306a531 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.408698 Jun 22 09:03:23.753772 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 167/340] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:23 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:24.536383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:24.536383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6ad88636-6a92-42fa-93a1-6d097bf67e3c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1370 microversion: 2.1 time: 0.679723 Jun 22 09:03:24.536383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 174/341] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:23 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1370 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:24.550629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:24.551271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:24.561535 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:24.562128 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:24.567796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:24.567796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:24.771210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:24.772273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:24.779175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:24.779636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:24.780817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:24.781547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:24.791751 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:24.800658 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9a8ca3d6-3354-4ee5-b96a-bc13e94138c9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1272 microversion: 2.1 time: 0.254344 Jun 22 09:03:24.802098 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 168/342] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:24 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:25.008123 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:25.030879 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c291159a-08f2-420f-9a38-b5cf4d2e3b30 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.256344 Jun 22 09:03:25.030879 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 175/343] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:24 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:25.502381 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:25.502989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:25.510286 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:25.521035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:25.521035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:25.521035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:25.649837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-7426ba1b-c230-4541-8439-d9a607ed8a31 req-358c6351-b310-407f-a8f3-3ca950d1f9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab18493a-f8df-4038-bd2d-85a40d3b0a36", "tag": "fd35cfa4-4e07-414b-bd41-0bbb96960edc"}, {"name": "network-changed", "server_uuid": "c7dd4b24-61df-4868-a828-c99798580375", "tag": "8322d52e-16ae-49fa-a614-eacc8025f50d"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:25.670783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:25.670783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-7426ba1b-c230-4541-8439-d9a607ed8a31 req-358c6351-b310-407f-a8f3-3ca950d1f9aa service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:25.670783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-7426ba1b-c230-4541-8439-d9a607ed8a31 req-358c6351-b310-407f-a8f3-3ca950d1f9aa service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:25.677876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-7426ba1b-c230-4541-8439-d9a607ed8a31 req-358c6351-b310-407f-a8f3-3ca950d1f9aa service nova] Creating event network-changed:fd35cfa4-4e07-414b-bd41-0bbb96960edc for instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 on hv-cinder-78729 Jun 22 09:03:25.678466 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-7426ba1b-c230-4541-8439-d9a607ed8a31 req-358c6351-b310-407f-a8f3-3ca950d1f9aa service nova] Creating event network-changed:8322d52e-16ae-49fa-a614-eacc8025f50d for instance c7dd4b24-61df-4868-a828-c99798580375 on hv-cinder-78729 Jun 22 09:03:25.690660 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-7426ba1b-c230-4541-8439-d9a607ed8a31 req-358c6351-b310-407f-a8f3-3ca950d1f9aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043916 Jun 22 09:03:25.691497 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 176/344] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:03:25.825416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:25.825938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:25.825938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:25.834237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:25.834681 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:25.835631 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:25.836261 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:25.836503 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1b14648a-9881-4b9d-b605-fcdf3c2ddf20 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1564 microversion: 2.1 time: 0.338075 Jun 22 09:03:25.837457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 169/345] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:25 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1564 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:25.855592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f9e0df9c-3655-4eaa-8a63-cda8445c8a63 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:25.856170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f9e0df9c-3655-4eaa-8a63-cda8445c8a63 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:25.863354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9e0df9c-3655-4eaa-8a63-cda8445c8a63 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:25.863934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9e0df9c-3655-4eaa-8a63-cda8445c8a63 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:25.864780 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9e0df9c-3655-4eaa-8a63-cda8445c8a63 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:25.865424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9e0df9c-3655-4eaa-8a63-cda8445c8a63 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:26.056867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f9e0df9c-3655-4eaa-8a63-cda8445c8a63 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205619 Jun 22 09:03:26.057836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 170/346] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:03:25 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:26.063421 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:26.069728 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:26.070766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:26.071570 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:26.072498 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:26.073080 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:26.280895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:26.285580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:26.300249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d1e358c6-7bfe-4f43-8404-4c7ccd41729f tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.485407 Jun 22 09:03:26.301230 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 177/347] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:25 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:26.435154 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:26.443609 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-27bf576d-82b5-418f-87bd-39a17421d5cd tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.384490 Jun 22 09:03:26.465389 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 171/348] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:26 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:27.220914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-04815ddd-22ab-4d46-b0ff-cab3a6784213 req-1ab69029-35be-47a3-9997-4df9e37a2158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0bc5af-2a76-4d82-a1c4-fba8eac05dba", "tag": "9245704a-8d26-4a4c-af84-7c9cacbb258e"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:27.225395 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=34 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:27.233198 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-04815ddd-22ab-4d46-b0ff-cab3a6784213 req-1ab69029-35be-47a3-9997-4df9e37a2158 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:27.233899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-04815ddd-22ab-4d46-b0ff-cab3a6784213 req-1ab69029-35be-47a3-9997-4df9e37a2158 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:27.246667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-04815ddd-22ab-4d46-b0ff-cab3a6784213 req-1ab69029-35be-47a3-9997-4df9e37a2158 service nova] Creating event network-changed:9245704a-8d26-4a4c-af84-7c9cacbb258e for instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba on hv-cinder-78729 Jun 22 09:03:27.252894 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-04815ddd-22ab-4d46-b0ff-cab3a6784213 req-1ab69029-35be-47a3-9997-4df9e37a2158 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038152 Jun 22 09:03:27.254701 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 178/349] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:27.317105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:27.317751 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:27.322648 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=8 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:27.327995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:27.328445 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:27.329518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:27.329959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:27.461445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:27.462178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:27.471320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:27.471769 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:27.472557 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:27.472995 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:27.531094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:27.541168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fad1a8e6-fac0-4a3c-b539-200aa69bbd64 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.228138 Jun 22 09:03:27.542247 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 172/350] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:27 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:27.640441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:27.648325 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-253e8fbb-3268-42b6-8c85-9faca69afa04 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.191111 Jun 22 09:03:27.648937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 179/351] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:27 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:28.560176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:28.561564 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:28.568829 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:28.569284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:28.570051 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:28.570919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:28.666878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:28.667559 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:28.676922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:28.677372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:28.678209 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:28.678730 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:29.270220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:29.278765 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dc94c154-1943-48c9-a18d-10486e2b6568 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.722498 Jun 22 09:03:29.279999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 173/352] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:28 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:29.316385 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:29.325712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4ed19020-d4bd-4771-8022-9022b014644a tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.663588 Jun 22 09:03:29.326991 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 180/353] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:28 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:30.300153 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:30.300682 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:30.307471 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:30.307912 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:30.308683 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:30.309117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:30.344469 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:30.345195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:30.351955 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:30.352526 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:30.353411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:30.353910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:30.499063 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:30.508693 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f71f67f2-c95c-4463-a391-0611348c787c tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.213731 Jun 22 09:03:30.509327 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 174/354] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:30 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:30.543251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:30.545285 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:30.550885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d2859226-1123-4105-b78e-71a29ff1c93d tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.210894 Jun 22 09:03:30.551388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 181/355] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:30 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:31.247246 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-3264817f-e8ca-4e95-8bec-1fa6251c1c61 req-e231fd1c-06f5-4470-b346-20eab15a21c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab18493a-f8df-4038-bd2d-85a40d3b0a36", "name": "network-vif-plugged", "status": "completed", "tag": "fd35cfa4-4e07-414b-bd41-0bbb96960edc"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:31.259006 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-3264817f-e8ca-4e95-8bec-1fa6251c1c61 req-e231fd1c-06f5-4470-b346-20eab15a21c1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:31.260171 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-3264817f-e8ca-4e95-8bec-1fa6251c1c61 req-e231fd1c-06f5-4470-b346-20eab15a21c1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:31.272048 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-3264817f-e8ca-4e95-8bec-1fa6251c1c61 req-e231fd1c-06f5-4470-b346-20eab15a21c1 service nova] Creating event network-vif-plugged:fd35cfa4-4e07-414b-bd41-0bbb96960edc for instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 on hv-cinder-78729 Jun 22 09:03:31.277139 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-3264817f-e8ca-4e95-8bec-1fa6251c1c61 req-e231fd1c-06f5-4470-b346-20eab15a21c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034346 Jun 22 09:03:31.277974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 175/356] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:31.525773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:31.526396 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:31.533814 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:31.534316 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:31.535183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:31.535625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:31.569336 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:31.570557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:31.584938 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:31.585380 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:31.586186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:31.586619 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:31.743625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:31.754896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8eb5e0fc-158c-4344-a4f3-f9d6edc458b9 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.232387 Jun 22 09:03:31.755795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 182/357] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:31 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:31.774691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:31.783774 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4f4ee504-996c-4411-9a52-f11806a281df tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.219094 Jun 22 09:03:31.784352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 176/358] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:31 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:32.772548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:32.773130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:32.780670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:32.781105 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:32.781953 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:32.782548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:32.806010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:32.806803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:32.813819 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:32.814319 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:32.815126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:32.815646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:32.989899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:32.998588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-27992863-be55-426e-95b5-5b36b3531f57 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.229371 Jun 22 09:03:33.008315 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 183/359] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:32 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:33.014398 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:33.021792 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7e8eebb1-f694-446b-9cc3-256dc8e2dbd1 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.219672 Jun 22 09:03:33.022376 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 177/360] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:32 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:34.016094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:34.016695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:34.023294 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:34.023734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:34.024491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:34.024920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:34.045819 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:34.046582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:34.053914 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:34.054756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:34.055931 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:34.056485 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:34.238158 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:34.241189 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:34.246911 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5ca8dee6-f937-4993-bf83-7985bf9c4cec tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.234720 Jun 22 09:03:34.247825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 184/361] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:34 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:34.251289 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-79cee238-e950-44c1-99c3-fee3cecfa016 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1313 microversion: 2.1 time: 0.210235 Jun 22 09:03:34.251868 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 178/362] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:34 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:35.263694 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:35.264956 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:35.267730 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:35.268900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:35.272846 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:35.273284 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:35.274314 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:35.274834 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:35.275672 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:35.276384 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:35.277177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:35.277674 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:35.607719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:35.612650 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:35.616392 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-07d06118-011e-4b42-8706-7e7bf3337323 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.356723 Jun 22 09:03:35.617055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 185/363] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:35 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:35.620489 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b520578f-f847-4193-a0c8-d47bede208c9 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1498 microversion: 2.1 time: 0.357275 Jun 22 09:03:35.621183 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 179/364] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:35 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:36.632539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:36.635500 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:36.640210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:36.640659 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:36.641429 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:36.641866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:36.680754 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:36.681536 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:36.689303 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:36.689748 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:36.690590 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:36.691026 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:36.717893 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:03:36.785169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:36.794040 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-01e948d5-30a6-42ae-9279-25a1c6facb7a tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.165216 Jun 22 09:03:36.794537 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 186/365] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:36 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:37.087373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5c6aa709-0361-4501-a58a-1a201b8f9113 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 204 len: 0 microversion: 2.1 time: 0.410493 Jun 22 09:03:37.088313 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 180/366] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:03:36 2022] DELETE /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:03:37.097176 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:37.099300 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:37.103974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:37.104419 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:37.105452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:37.105937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:37.247394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:37.254892 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9a900e60-993a-425b-876a-083e1061cb26 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1504 microversion: 2.1 time: 0.161488 Jun 22 09:03:37.255474 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 187/367] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:37 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:37.811843 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:37.812989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:37.821645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:37.822348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:37.823517 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:37.824267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:37.986614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:37.994882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fd41427f-4b1b-4064-a5c4-ceae0a7692a0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.187595 Jun 22 09:03:37.995470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 181/368] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:37 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:38.273078 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:38.273682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:38.281314 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:38.281840 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:38.282747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:38.283222 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:38.439762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:38.439762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2bd3a1fa-aa83-4c9c-8977-1e9688a4d992 tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1504 microversion: 2.1 time: 0.158332 Jun 22 09:03:38.439762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 188/369] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:38 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:39.012897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:39.014182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:39.021205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:39.021655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:39.022467 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:39.022900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:39.041909 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:39.263910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:39.272120 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6f13b48e-11b8-4b89-86cc-0b46d64cf161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.263329 Jun 22 09:03:39.272697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 182/370] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:39 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:03:39.349224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-eb943268-6604-4ade-826e-7b0bdcb4b60a req-5b1201cf-1803-4a5b-a949-97087af56b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7dd4b24-61df-4868-a828-c99798580375", "name": "network-vif-plugged", "status": "completed", "tag": "8322d52e-16ae-49fa-a614-eacc8025f50d"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:39.360328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-eb943268-6604-4ade-826e-7b0bdcb4b60a req-5b1201cf-1803-4a5b-a949-97087af56b4e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:39.360873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-eb943268-6604-4ade-826e-7b0bdcb4b60a req-5b1201cf-1803-4a5b-a949-97087af56b4e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:39.372407 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-eb943268-6604-4ade-826e-7b0bdcb4b60a req-5b1201cf-1803-4a5b-a949-97087af56b4e service nova] Creating event network-vif-plugged:8322d52e-16ae-49fa-a614-eacc8025f50d for instance c7dd4b24-61df-4868-a828-c99798580375 on hv-cinder-78729 Jun 22 09:03:39.378947 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-eb943268-6604-4ade-826e-7b0bdcb4b60a req-5b1201cf-1803-4a5b-a949-97087af56b4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034062 Jun 22 09:03:39.379776 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 189/371] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:39.445578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:39.446579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:39.454811 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:39.458707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:39.458707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:39.458707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:39.626199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:39.633919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-361698a6-d382-41cc-9761-402f77715ded tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1504 microversion: 2.1 time: 0.192756 Jun 22 09:03:39.634506 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 183/372] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:39 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:39.784202 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-4539daf9-189f-447a-bd7e-83b7a5be7143 req-978e8631-36d3-447a-b21f-8b5892fb3ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab18493a-f8df-4038-bd2d-85a40d3b0a36", "name": "network-vif-deleted", "tag": "fd35cfa4-4e07-414b-bd41-0bbb96960edc"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:39.795519 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-4539daf9-189f-447a-bd7e-83b7a5be7143 req-978e8631-36d3-447a-b21f-8b5892fb3ab9 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:39.795964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-4539daf9-189f-447a-bd7e-83b7a5be7143 req-978e8631-36d3-447a-b21f-8b5892fb3ab9 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:39.807498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-4539daf9-189f-447a-bd7e-83b7a5be7143 req-978e8631-36d3-447a-b21f-8b5892fb3ab9 service nova] Creating event network-vif-deleted:fd35cfa4-4e07-414b-bd41-0bbb96960edc for instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 on hv-cinder-78729 Jun 22 09:03:39.816774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-4539daf9-189f-447a-bd7e-83b7a5be7143 req-978e8631-36d3-447a-b21f-8b5892fb3ab9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038291 Jun 22 09:03:39.817844 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 190/373] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:40.292004 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:40.292731 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:40.301516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:40.301957 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:40.302831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:40.303264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:40.442986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:40.450294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1f802ff3-a61f-463f-bae9-f697cf254254 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.165321 Jun 22 09:03:40.450994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 184/374] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:40 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:40.652864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:40.653562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:40.660935 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:40.661371 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:40.662259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:40.662655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:40.697433 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:40.697952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:40.698360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lazy-loading 'fault' on Instance uuid ab18493a-f8df-4038-bd2d-85a40d3b0a36 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:03:40.742273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:40.749812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8da59d09-fca8-4a7b-bfd6-3aaa5ab2baaa tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1303 microversion: 2.1 time: 0.102226 Jun 22 09:03:40.750399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 191/375] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:40 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:41.468468 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:41.469090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:41.476078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:41.476520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:41.477277 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:41.477704 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:41.617577 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:41.625553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-27ddf4a7-4ffe-4233-a6f7-c335b6caa126 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1260 microversion: 2.1 time: 0.161486 Jun 22 09:03:41.626139 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 185/376] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:41 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:41.768138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:41.768857 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:41.776523 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:41.777369 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:41.778099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:41.778548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:41.814382 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:41.814850 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:41.815292 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lazy-loading 'fault' on Instance uuid ab18493a-f8df-4038-bd2d-85a40d3b0a36 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:03:41.860437 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae42e04bd49ecae3fd63cd5b52a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb16c610a94371b896183858e4c1d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:41.868192 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-26ab3259-a122-4883-8fa1-1f963d6d021f tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 200 len: 1303 microversion: 2.1 time: 0.104517 Jun 22 09:03:41.868991 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 192/377] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:41 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:42.642618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:42.643347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:42.650276 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:42.650674 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:42.651483 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:42.651936 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:42.789060 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:42.797234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-97e2d731-c11a-42f5-8f3c-424d8469e284 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1444 microversion: 2.1 time: 0.159632 Jun 22 09:03:42.797792 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 186/378] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:42 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:42.814588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:42.815281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:42.821892 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:42.822380 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:42.823290 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:42.823735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:42.886408 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:42.887019 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] [instance: ab18493a-f8df-4038-bd2d-85a40d3b0a36] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:42.894872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:42.895314 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:42.896510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:42.896625 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:42.911290 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] HTTP exception thrown: Instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 could not be found. Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Request method failure captured: Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 HTTP/1.1 Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistqoPM-4lfd0pJWSj4ld5dMxZwfXpx_w2jPVrGU77OwhE1ke7mBepZyqL5AbcaZK74U_2exXKV2il1nM9BZ8XzGYsptNf2vibT1wSw3HRyT02gMWecsitPumOhwy08DnYaYAi9FZeNjJ5BP1felYqc9PbITiKinF--r4wOdvRM80aTo Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 9beb16c610a94371b896183858e4c1d5 Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesActionsTest-1395454310 Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:03:42.912860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9beb16c610a94371b896183858e4c1d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9beb16c610a94371b896183858e4c1d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9beb16c610a94371b896183858e4c1d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9beb16c610a94371b896183858e4c1d5"}]}] Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesActionsTest-1395454310 Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 9beb16c610a94371b896183858e4c1d5 Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesActionsTest-1395454310 Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesActionsTest-1395454310-project Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: e4eae42e04bd49ecae3fd63cd5b52a43 Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesActionsTest-1395454310-project Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 could not be found. Jun 22 09:03:42.914368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'ab18493a-f8df-4038-bd2d-85a40d3b0a36'} Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 could not be found. Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:03:42.915111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 could not be found. Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 could not be found. Jun 22 09:03:42.916411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:03:42.917478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] Returning 404 to user: Instance ab18493a-f8df-4038-bd2d-85a40d3b0a36 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:03:42.917478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e2126e1f-f10b-4aae-89db-24ee864d51ef tempest-VolumesActionsTest-1395454310 tempest-VolumesActionsTest-1395454310-project] 10.222.0.36 "GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36" status: 404 len: 111 microversion: 2.1 time: 0.031766 Jun 22 09:03:42.918641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 187/379] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:42 2022] GET /compute/v2.1/servers/ab18493a-f8df-4038-bd2d-85a40d3b0a36 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:03:42.973996 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:03:42.982398 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b3abb3f9-6594-4527-99b2-614cfcee63ad tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1444 microversion: 2.1 time: 0.172254 Jun 22 09:03:42.983557 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 193/380] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:03:42 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:03:45.369642 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-fe62d128-3d9d-4af6-9455-1cdf17ce40c4 req-7206e369-95af-4ffa-a240-bc3f504e25cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7dd4b24-61df-4868-a828-c99798580375", "tag": "8322d52e-16ae-49fa-a614-eacc8025f50d"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:03:45.378525 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-fe62d128-3d9d-4af6-9455-1cdf17ce40c4 req-7206e369-95af-4ffa-a240-bc3f504e25cb service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:45.378960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-fe62d128-3d9d-4af6-9455-1cdf17ce40c4 req-7206e369-95af-4ffa-a240-bc3f504e25cb service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:45.395000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-fe62d128-3d9d-4af6-9455-1cdf17ce40c4 req-7206e369-95af-4ffa-a240-bc3f504e25cb service nova] Creating event network-changed:8322d52e-16ae-49fa-a614-eacc8025f50d for instance c7dd4b24-61df-4868-a828-c99798580375 on hv-cinder-78729 Jun 22 09:03:45.400739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-fe62d128-3d9d-4af6-9455-1cdf17ce40c4 req-7206e369-95af-4ffa-a240-bc3f504e25cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034683 Jun 22 09:03:45.404329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 188/381] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:03:59.236679 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d04ffa41-a20d-451b-a42d-52f3aa1ad3bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:03:59.240775 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d04ffa41-a20d-451b-a42d-52f3aa1ad3bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:03:59.250819 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=83 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:59.252611 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=68 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:59.264612 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d04ffa41-a20d-451b-a42d-52f3aa1ad3bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:59.265620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d04ffa41-a20d-451b-a42d-52f3aa1ad3bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:59.266906 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d04ffa41-a20d-451b-a42d-52f3aa1ad3bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:03:59.267445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d04ffa41-a20d-451b-a42d-52f3aa1ad3bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:03:59.319370 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d04ffa41-a20d-451b-a42d-52f3aa1ad3bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/ips" status: 200 len: 152 microversion: 2.20 time: 0.093996 Jun 22 09:03:59.326939 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 194/382] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Jun 22 09:03:59 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/ips => generated 152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:04:02.655271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:02.656008 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=30 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:02.660792 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:02.661469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:02.671650 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:02.672394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:02.673612 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:02.674356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:02.705301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lazy-loading 'flavor' on Instance uuid 570dea14-f80c-45cc-9935-7cf6d445d337 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:04:03.408226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2656398c-2fdd-493b-a57b-b0d83e95678c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/action" status: 202 len: 0 microversion: 2.20 time: 0.755522 Jun 22 09:04:03.412697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 189/383] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 09:04:02 2022] POST /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:04:03.423355 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:03.424061 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:03.444503 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:03.445230 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:03.446035 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:03.446479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:03.706698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:03.717716 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:03.719885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:03.721416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ecc28ecc-498a-4693-aa5d-d9e8b8da749e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.307945 Jun 22 09:04:03.722874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 195/384] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:03 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:04.753060 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:04.753818 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:04.760999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:04.761628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:04.762352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:04.762799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:04.920885 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:04.931592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:04.933158 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:04.934419 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c5012e5b-670c-4614-aae1-a77318d4a2fb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.186187 Jun 22 09:04:04.935911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 190/385] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:04 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:05.953775 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:05.954443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:05.961687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:05.962432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:05.963393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:05.963987 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:06.123212 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:06.134855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:06.136392 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:06.137533 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f8e53073-aee4-4730-8ce0-c6b4a1581fa8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.188325 Jun 22 09:04:06.148882 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 196/386] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:05 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:07.156319 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:07.157145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:07.163370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:07.170326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:07.170326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:07.170326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:07.309171 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:07.319479 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:07.320083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:07.321251 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9bd297c9-1e8d-422a-985c-c327385507ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.168990 Jun 22 09:04:07.321804 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 191/387] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:07 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:08.342082 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:08.342729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:08.349388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:08.349837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:08.350616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:08.351053 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:08.489370 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:08.497238 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:08.499271 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:08.500423 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8be7f882-a54a-403f-bfd9-ed50272f224f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.162533 Jun 22 09:04:08.500986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 197/388] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:08 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:09.519250 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:09.522869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:09.526524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:09.526970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:09.527740 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:09.528174 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:09.669665 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:09.678531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:09.680175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:09.681357 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4106d4c1-e965-4cfa-a918-1933afb71788 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.166108 Jun 22 09:04:09.682245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 192/389] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:09 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:10.701498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:10.702333 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:10.709868 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:10.710469 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:10.711276 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:10.711727 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:10.886441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:10.895031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:10.896531 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:10.897795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5fdf21bc-13f1-4405-9ce7-8d99bac244cc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.200427 Jun 22 09:04:10.898375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 198/390] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:10 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:11.917353 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:11.917913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:11.928824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:11.929583 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:11.933753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:11.935341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:12.084064 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:12.094877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:12.096824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:12.098284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-25b89b86-7d26-41b2-98dd-ec07e79648ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.185289 Jun 22 09:04:12.098893 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 193/391] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:11 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:13.118944 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:13.119959 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:13.127234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:13.127696 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:13.128489 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:13.128932 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:13.298195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:13.306482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:13.309277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:13.309820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0fb41575-306e-4d9c-8dcc-0fcf9d9ea1e0 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.195074 Jun 22 09:04:13.310413 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 199/392] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:13 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:14.330083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:14.330735 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:14.338740 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:14.339789 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:14.340508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:14.341233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:14.495516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:14.505237 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:14.507074 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:14.508458 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-32fb3bca-8d79-4344-bbe7-0263d16a9cd8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.183293 Jun 22 09:04:14.509274 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 194/393] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:14 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:15.527865 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:15.528468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:15.535216 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:15.535662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:15.536446 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:15.536854 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:15.793368 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:15.803609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:15.805536 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:15.807020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-086fe6c4-5baa-4ce0-9ee3-fad85cf0c101 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.283154 Jun 22 09:04:15.807655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 200/394] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:15 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:16.824919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:16.826267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:16.834108 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:16.834812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:16.835792 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:16.836366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:17.316742 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:17.327213 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:17.329069 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:17.330342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3c9df8b1-323c-4ea4-84f2-79385dda5268 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.509351 Jun 22 09:04:17.341431 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 195/395] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:16 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:18.349777 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:18.351821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:18.358779 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:18.359588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:18.360617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:18.361237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:18.614287 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:18.625590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:18.629492 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:18.630795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fce66d9c-00c7-44c4-959e-5f40fe04249b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.285150 Jun 22 09:04:18.631363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 201/396] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:18 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:19.034755 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-33980930-df9b-42eb-a222-cba75a9d29cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:19.035266 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-33980930-df9b-42eb-a222-cba75a9d29cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:19.041948 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-33980930-df9b-42eb-a222-cba75a9d29cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.042424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-33980930-df9b-42eb-a222-cba75a9d29cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.043203 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-33980930-df9b-42eb-a222-cba75a9d29cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.043641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-33980930-df9b-42eb-a222-cba75a9d29cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.078262 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-33980930-df9b-42eb-a222-cba75a9d29cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721/ips" status: 200 len: 149 microversion: 2.1 time: 0.047230 Jun 22 09:04:19.080241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 196/397] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:04:19 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:19.089978 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fd93d07-1299-43a9-beb4-d5a8cdc85a57"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:19.091084 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:19.098014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.098521 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.099301 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.099741 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.190774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Invalid volume: volume 2fd93d07-1299-43a9-beb4-d5a8cdc85a57 is already attached to instances: 4728bbe3-835f-4432-b8a2-bd1ff5352341 Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: POST /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721/os-volume_attachments HTTP/1.1 Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 74 Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:04:19.192754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {"volumeAttachment": {"volumeId": "2fd93d07-1299-43a9-beb4-d5a8cdc85a57"}} Jun 22 09:04:19.198641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Invalid volume: volume 2fd93d07-1299-43a9-beb4-d5a8cdc85a57 is already attached to instances: 4728bbe3-835f-4432-b8a2-bd1ff5352341 Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'server_id': 'cb3f60b3-c6b7-473b-97a3-a83de42be721', 'body': {'volumeAttachment': {'volumeId': '2fd93d07-1299-43a9-beb4-d5a8cdc85a57'}}} Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2fd93d07-1299-43a9-beb4-d5a8cdc85a57 is already attached to instances: 4728bbe3-835f-4432-b8a2-bd1ff5352341 Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:19.199400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2fd93d07-1299-43a9-beb4-d5a8cdc85a57 is already attached to instances: 4728bbe3-835f-4432-b8a2-bd1ff5352341 Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:19.200540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2fd93d07-1299-43a9-beb4-d5a8cdc85a57 is already attached to instances: 4728bbe3-835f-4432-b8a2-bd1ff5352341 Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 400 to user: Invalid volume: volume 2fd93d07-1299-43a9-beb4-d5a8cdc85a57 is already attached to instances: 4728bbe3-835f-4432-b8a2-bd1ff5352341 {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-239a5b5e-ea82-423c-afda-756f72677bec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108585 Jun 22 09:04:19.203240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 202/398] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:04:19 2022] POST /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:04:19.208826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:19.209526 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:19.217046 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.222261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.222261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.222261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.246891 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:04:19.654712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:19.655373 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:19.663484 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.663900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.664664 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.665096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.725685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f7b791ab-7b32-466e-bf20-a7493d3ad94b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 204 len: 0 microversion: 2.1 time: 0.516753 Jun 22 09:04:19.725685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 197/399] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:04:19 2022] DELETE /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:04:19.736862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:19.738093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:19.744417 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.745049 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.745833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:19.746297 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:19.871188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:19.883981 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:19.887390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:19.887390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-716e956e-1c71-42a7-bc9c-39cbcd89eb9c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.236927 Jun 22 09:04:19.887390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 203/400] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:19 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:19.928329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:19.935940 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-20d58625-65bb-43f0-8691-c0b6bf73f156 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1681 microversion: 2.1 time: 0.206703 Jun 22 09:04:19.936503 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 198/401] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:19 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:20.904812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:20.909135 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:20.912011 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:20.912452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:20.913204 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:20.913643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:20.954248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:20.954978 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:20.964612 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:20.965363 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:20.966406 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:20.967150 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:21.489304 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:21.514258 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:21.518649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:21.521488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-80f25da5-ea9a-48f6-9dc2-24dee884169a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.620290 Jun 22 09:04:21.524344 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 204/402] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:20 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:21.531083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:21.544660 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-832b670a-e167-4875-a3f6-ccad789a400c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1681 microversion: 2.1 time: 0.595475 Jun 22 09:04:21.557130 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 199/403] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:20 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1681 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:22.546970 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:22.548433 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:22.562438 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.563197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:22.565280 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.568648 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:22.575415 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:22.576854 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:22.598575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.599320 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:22.605748 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.606511 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:22.846246 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:22.863878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-860634b6-4277-450a-a459-c68acd009432 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1613 microversion: 2.1 time: 0.292647 Jun 22 09:04:22.864739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 200/404] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:22 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1613 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:22.880913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-673189ec-d2d3-4f69-afa0-b77efefcd39a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57a18ba4-f747-48a6-8b4f-101a734fd94d"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:22.887132 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-673189ec-d2d3-4f69-afa0-b77efefcd39a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:22.903990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-673189ec-d2d3-4f69-afa0-b77efefcd39a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.905457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-673189ec-d2d3-4f69-afa0-b77efefcd39a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:22.906608 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-673189ec-d2d3-4f69-afa0-b77efefcd39a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:22.907215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-673189ec-d2d3-4f69-afa0-b77efefcd39a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:23.169582 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:23.188738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:23.204308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:23.209783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:23.211842 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0a386baa-b253-40d9-a441-73a323f44555 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.671514 Jun 22 09:04:23.219661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 205/405] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:22 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:23.225958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-1553a102-186f-405a-b58a-fa1c39d73651 req-25e661e2-e2f3-4246-9443-013f002c7e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3f60b3-c6b7-473b-97a3-a83de42be721", "name": "network-vif-deleted", "tag": "58aea969-8187-49bf-85e8-f39697542c80"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:23.250164 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-1553a102-186f-405a-b58a-fa1c39d73651 req-25e661e2-e2f3-4246-9443-013f002c7e0d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:23.251597 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-1553a102-186f-405a-b58a-fa1c39d73651 req-25e661e2-e2f3-4246-9443-013f002c7e0d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:23.267726 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-1553a102-186f-405a-b58a-fa1c39d73651 req-25e661e2-e2f3-4246-9443-013f002c7e0d service nova] Creating event network-vif-deleted:58aea969-8187-49bf-85e8-f39697542c80 for instance cb3f60b3-c6b7-473b-97a3-a83de42be721 on hv-cinder-78729 Jun 22 09:04:23.280757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-1553a102-186f-405a-b58a-fa1c39d73651 req-25e661e2-e2f3-4246-9443-013f002c7e0d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059593 Jun 22 09:04:23.281722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 206/406] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:23.886762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:23.888190 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:23.918522 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:23.925867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:23.925867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:23.925867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:23.969475 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:23.970579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:23.971419 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lazy-loading 'fault' on Instance uuid cb3f60b3-c6b7-473b-97a3-a83de42be721 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:04:24.032065 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:24.051064 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-673189ec-d2d3-4f69-afa0-b77efefcd39a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.184381 Jun 22 09:04:24.055396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 201/407] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:04:22 2022] POST /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 194 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:24.060022 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-cfa4bdb6-0ed9-4626-9111-490d8ce51d6b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 200 len: 1331 microversion: 2.1 time: 0.179706 Jun 22 09:04:24.062017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 207/408] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:23 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 1331 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:24.247142 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:24.251834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:24.271726 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:24.274042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:24.275203 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:24.276046 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:24.579915 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:24.596385 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:24.613068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:24.625128 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e407f02a-1043-433e-bfbb-6e61e1b566ac tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.389153 Jun 22 09:04:24.636343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 202/409] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:24 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:25.080657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:25.081910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:25.103246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:25.103970 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:25.105361 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:25.105981 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:25.136029 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 HTTP/1.1 Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:04:25.141693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:04:25.143139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'cb3f60b3-c6b7-473b-97a3-a83de42be721'} Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:04:25.143825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:04:25.145197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:25.146487 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:04:25.146487 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-51e9f129-b009-45df-b36c-2e2dcfe6f8e0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 404 len: 111 microversion: 2.1 time: 0.065108 Jun 22 09:04:25.146487 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 208/410] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:25 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:04:25.162088 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c7f92d8a-d0c2-45b2-a47f-917a3bb967c0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '.version_select at 0x7fb332083c10>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:25.285579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c7f92d8a-d0c2-45b2-a47f-917a3bb967c0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785598927" status: 202 len: 0 microversion: 2.1 time: 0.137781 Jun 22 09:04:25.286200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 203/411] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Jun 22 09:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785598927 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:04:25.658641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:25.660128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:25.677718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:25.678428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:25.679418 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:25.680019 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:26.341535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:26.351363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:26.352926 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:26.355081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a63fa905-3ed7-4361-b67c-9fac24c68d27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1743 microversion: 2.20 time: 0.701147 Jun 22 09:04:26.356270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 209/412] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:25 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1743 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:26.608769 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:26.610256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:26.618309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:26.618988 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:26.621074 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:26.622042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:26.800191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lazy-loading 'services' on Instance uuid 4728bbe3-835f-4432-b8a2-bd1ff5352341 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:04:27.119249 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b5a54cb4-17a7-44ab-8b47-8dfb66af4343 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments/2fd93d07-1299-43a9-beb4-d5a8cdc85a57" status: 202 len: 0 microversion: 2.1 time: 0.515065 Jun 22 09:04:27.120599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 204/413] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:04:26 2022] DELETE /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments/2fd93d07-1299-43a9-beb4-d5a8cdc85a57 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:04:27.129204 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-43cd8481-27fd-470e-aff5-2fa8158e4d9d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:27.130380 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-43cd8481-27fd-470e-aff5-2fa8158e4d9d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:27.139747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43cd8481-27fd-470e-aff5-2fa8158e4d9d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:27.162672 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43cd8481-27fd-470e-aff5-2fa8158e4d9d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:27.163908 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43cd8481-27fd-470e-aff5-2fa8158e4d9d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:27.163908 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-43cd8481-27fd-470e-aff5-2fa8158e4d9d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:27.220016 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-43cd8481-27fd-470e-aff5-2fa8158e4d9d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094181 Jun 22 09:04:27.222603 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 210/414] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:04:27 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:27.376105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:27.376989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:27.384700 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:27.385399 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:27.386623 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:27.387782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:27.745703 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:27.762437 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:27.766999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:27.772090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4c7c27f4-ef5e-410f-845b-da646e3aca66 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.400984 Jun 22 09:04:27.787111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 205/415] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:27 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:28.234037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a928bdc4-2668-49ea-9fe5-df179be1c1d1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:28.236542 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a928bdc4-2668-49ea-9fe5-df179be1c1d1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:28.246400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a928bdc4-2668-49ea-9fe5-df179be1c1d1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:28.247192 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a928bdc4-2668-49ea-9fe5-df179be1c1d1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:28.248810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a928bdc4-2668-49ea-9fe5-df179be1c1d1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:28.249313 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a928bdc4-2668-49ea-9fe5-df179be1c1d1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:28.301693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:28.307479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a928bdc4-2668-49ea-9fe5-df179be1c1d1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077685 Jun 22 09:04:28.308434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 211/416] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:04:28 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:28.796987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:28.798335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:28.809302 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:28.809693 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:28.810557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:28.811284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:29.125287 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:29.136292 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:29.138088 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:29.139803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d23d06f0-e125-4953-ab6c-b863fbc49f42 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.349242 Jun 22 09:04:29.140364 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 206/417] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:28 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:29.321050 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-977b0bd9-3888-46af-b821-d14588388550 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:29.386943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-977b0bd9-3888-46af-b821-d14588388550 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:29.386943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=39 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:29.386943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-977b0bd9-3888-46af-b821-d14588388550 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:29.386943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-977b0bd9-3888-46af-b821-d14588388550 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:29.387904 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-977b0bd9-3888-46af-b821-d14588388550 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:29.387904 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-977b0bd9-3888-46af-b821-d14588388550 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:29.465719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-977b0bd9-3888-46af-b821-d14588388550 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149152 Jun 22 09:04:29.472021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 212/418] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:04:29 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:29.745912 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-7b4bb6bf-98e2-4795-bd89-cdef5d79f975 req-91f729ac-1b99-4952-8b45-2259778037d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570dea14-f80c-45cc-9935-7cf6d445d337", "name": "network-vif-plugged", "status": "completed", "tag": "be31663b-fa96-458a-8d8e-4d90d98f36db"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:29.745912 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-7b4bb6bf-98e2-4795-bd89-cdef5d79f975 req-91f729ac-1b99-4952-8b45-2259778037d0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:29.745912 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-7b4bb6bf-98e2-4795-bd89-cdef5d79f975 req-91f729ac-1b99-4952-8b45-2259778037d0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:29.771882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-7b4bb6bf-98e2-4795-bd89-cdef5d79f975 req-91f729ac-1b99-4952-8b45-2259778037d0 service nova] Creating event network-vif-plugged:be31663b-fa96-458a-8d8e-4d90d98f36db for instance 570dea14-f80c-45cc-9935-7cf6d445d337 on hv-cinder-78729 Jun 22 09:04:29.809353 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-7b4bb6bf-98e2-4795-bd89-cdef5d79f975 req-91f729ac-1b99-4952-8b45-2259778037d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075753 Jun 22 09:04:29.811662 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 207/419] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:30.162087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:30.163422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:30.175889 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:30.178053 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:30.186567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:30.187277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:30.404616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:30.413273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:30.422220 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:30.426210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c5c4e1fa-a2b3-470a-a3f1-495eb1599d6c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.266122 Jun 22 09:04:30.426210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 213/420] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:30 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:30.489032 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dda313db-16cf-45ec-ad1e-00fa66b43322 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:30.490045 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dda313db-16cf-45ec-ad1e-00fa66b43322 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:30.508364 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dda313db-16cf-45ec-ad1e-00fa66b43322 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:30.508815 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dda313db-16cf-45ec-ad1e-00fa66b43322 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:30.509593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dda313db-16cf-45ec-ad1e-00fa66b43322 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:30.510022 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dda313db-16cf-45ec-ad1e-00fa66b43322 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:30.595224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dda313db-16cf-45ec-ad1e-00fa66b43322 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111380 Jun 22 09:04:30.595827 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 208/421] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:04:30 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:31.443061 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:31.444507 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:31.458036 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:31.469139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:31.472490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:31.472490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:31.613807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d52ee215-3e9a-4923-ad02-d51651f8f496 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:31.614825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d52ee215-3e9a-4923-ad02-d51651f8f496 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:31.687882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d52ee215-3e9a-4923-ad02-d51651f8f496 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:31.687882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d52ee215-3e9a-4923-ad02-d51651f8f496 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:31.687882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d52ee215-3e9a-4923-ad02-d51651f8f496 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:31.687882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d52ee215-3e9a-4923-ad02-d51651f8f496 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:31.689142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:31.692895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:31.695961 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:31.697845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f749ff06-0b26-4330-bad6-e8aa3be4fde7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.259231 Jun 22 09:04:31.711302 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 214/422] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:31 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:31.744343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d52ee215-3e9a-4923-ad02-d51651f8f496 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141085 Jun 22 09:04:31.751255 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 209/423] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:04:31 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:32.718678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:32.719598 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:32.728312 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.729179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.730539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.731112 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.764432 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a33a9dbb-196c-4453-9629-1135283b79ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:32.766845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a33a9dbb-196c-4453-9629-1135283b79ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:32.769633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:32.777153 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a33a9dbb-196c-4453-9629-1135283b79ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.777610 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a33a9dbb-196c-4453-9629-1135283b79ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.778596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a33a9dbb-196c-4453-9629-1135283b79ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:32.779135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a33a9dbb-196c-4453-9629-1135283b79ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:32.813398 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a33a9dbb-196c-4453-9629-1135283b79ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055007 Jun 22 09:04:32.814107 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 210/424] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:04:32 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:32.956491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:32.974272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:32.979258 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:32.981653 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ff0b61a0-f0ab-445e-979e-71099ccce953 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.267661 Jun 22 09:04:32.984115 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 215/425] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:32 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:33.031870 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:33.032902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:33.039740 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.040223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.041295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.041738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.068127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lazy-loading 'flavor' on Instance uuid 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:04:33.586606 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-438c3098-2847-4446-98d3-9842f856ae3f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/action" status: 200 len: 32 microversion: 2.1 time: 0.558594 Jun 22 09:04:33.587470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 211/426] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:04:33 2022] POST /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/action => generated 32 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:04:33.606416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:33.612772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:33.634335 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.637278 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.639457 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.640612 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.835185 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-90581ed1-20fe-4667-ac1c-2746fb1b9781 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:33.836949 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-90581ed1-20fe-4667-ac1c-2746fb1b9781 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:33.870669 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-90581ed1-20fe-4667-ac1c-2746fb1b9781 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.871040 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-90581ed1-20fe-4667-ac1c-2746fb1b9781 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.871822 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-90581ed1-20fe-4667-ac1c-2746fb1b9781 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:33.872253 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-90581ed1-20fe-4667-ac1c-2746fb1b9781 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:33.967102 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-90581ed1-20fe-4667-ac1c-2746fb1b9781 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144944 Jun 22 09:04:33.973053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 212/427] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:04:33 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:04:34.009068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:34.010379 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:34.032066 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:34.032691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:34.033670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:34.034236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:34.635576 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:34.647567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:34.664770 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6ad9fbef-b92c-4516-8b3e-d961fbc84ce8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 1.071004 Jun 22 09:04:34.678620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 216/428] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:33 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:34.681155 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:34.692884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:34.707247 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:34.707247 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:34.711829 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0e86453b-7cd5-48d3-ae33-28cd8e055420 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.710185 Jun 22 09:04:34.712960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 213/429] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:34 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:34.738219 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:34.738994 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:34.746822 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:34.748280 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:34.813174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:04:35.221094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fb8efe06-0a37-48a9-bf35-2f8cea4cc1cc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 204 len: 0 microversion: 2.1 time: 0.541315 Jun 22 09:04:35.222127 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 217/430] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:04:34 2022] DELETE /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:04:35.232991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:35.234921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:35.242502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.245919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.250114 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.250741 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.482230 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:35.499659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-84b2496a-f9a0-4cca-bc63-020558b62116 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1680 microversion: 2.1 time: 0.273263 Jun 22 09:04:35.504540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 214/431] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:35 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:35.684187 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:35.686185 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:35.697987 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.701505 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.705075 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.705617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.730924 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:35.731923 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:35.746801 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.750785 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.753136 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:35.763997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:35.984446 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:35.995057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4a838e85-ef5d-4a94-af20-f97e81cca1d3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.315573 Jun 22 09:04:36.003567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 218/432] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:35 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:36.073735 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:36.084305 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:36.087736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:36.090019 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-76a87028-f55b-4b8c-87bd-5e131146af8f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.363088 Jun 22 09:04:36.091416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 215/433] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:35 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:36.522244 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:36.523246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:36.530522 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:36.538085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:36.539316 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:36.539977 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:37.016472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:37.020215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:37.025603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:37.026187 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:37.027045 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:37.027552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:37.056951 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:37.088863 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:37.097139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-72025a2b-f429-4999-bd37-9cf439e0e685 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1680 microversion: 2.1 time: 0.579019 Jun 22 09:04:37.097708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 219/434] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:36 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1680 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:37.109789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:37.111658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:37.117971 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:37.118447 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:37.119234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:37.119661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:37.779875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:37.779875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9270c726-7f48-4ad2-ba5b-207faee78cb5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.741032 Jun 22 09:04:37.779875 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 216/435] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:37 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:37.828787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:37.838399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:37.840208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:37.843254 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fa998c01-90e9-4506-b8c2-455b1f940388 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.736646 Jun 22 09:04:37.843997 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 220/436] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:37 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:38.116988 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:38.117591 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:38.126337 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:38.126794 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:38.127584 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:38.128043 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:38.344416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:38.352800 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5bfcc561-4ee2-492d-bbab-aea9d099728c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1680 microversion: 2.1 time: 0.239681 Jun 22 09:04:38.364018 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 217/437] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:38 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:38.769674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:38.770341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:38.792731 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:38.795487 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:38.804637 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:38.805489 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:38.824107 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-cbe748f5-985b-40b7-9877-ef18a4db222e req-ba96b4f8-3cd9-45e7-8b91-786f1c0a819a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4728bbe3-835f-4432-b8a2-bd1ff5352341", "name": "network-vif-deleted", "tag": "0b34c90a-22d5-4720-ad3f-ff0d35f7ded7"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:38.847029 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-cbe748f5-985b-40b7-9877-ef18a4db222e req-ba96b4f8-3cd9-45e7-8b91-786f1c0a819a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:38.852960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-cbe748f5-985b-40b7-9877-ef18a4db222e req-ba96b4f8-3cd9-45e7-8b91-786f1c0a819a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:38.920056 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-cbe748f5-985b-40b7-9877-ef18a4db222e req-ba96b4f8-3cd9-45e7-8b91-786f1c0a819a service nova] Creating event network-vif-deleted:0b34c90a-22d5-4720-ad3f-ff0d35f7ded7 for instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 on hv-cinder-78729 Jun 22 09:04:38.959918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-cbe748f5-985b-40b7-9877-ef18a4db222e req-ba96b4f8-3cd9-45e7-8b91-786f1c0a819a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110382 Jun 22 09:04:38.962199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 218/438] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:38.988282 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:38.991046 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:39.009049 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:39.016723 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:39.024968 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:39.038718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:39.522895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:39.533533 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2f73d2b0-4f9a-4515-ab81-f9236f35fec8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.767706 Jun 22 09:04:39.534135 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 221/439] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:38 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:39.555660 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:39.573239 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:39.579509 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:39.581132 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-08342f3f-a23e-45ac-8db8-9c1d72569e24 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.617676 Jun 22 09:04:39.585479 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 219/440] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:38 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:39.610114 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:39.610737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:39.633931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:39.634410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:39.641031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:39.641031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:39.716066 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:39.716954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:39.717618 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lazy-loading 'fault' on Instance uuid 4728bbe3-835f-4432-b8a2-bd1ff5352341 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:04:39.857625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:39.885894 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5090c557-b81f-44eb-9bd8-e0c89d7d205a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 200 len: 1332 microversion: 2.1 time: 0.310532 Jun 22 09:04:39.887414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 222/441] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:39 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 1332 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:40.554077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:40.555125 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:40.572359 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:40.573000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:40.579849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:40.580446 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:40.609208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:40.609821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:40.631535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:40.631986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:40.632773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:40.633208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:40.990939 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:41.012704 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:41.022890 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:41.031547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-227379b5-6164-4d91-b69f-bf45db358011 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.426903 Jun 22 09:04:41.032167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 223/442] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:40 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:41.046373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:41.056005 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c9b82098-2331-4539-a249-ded9631e67e6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.505950 Jun 22 09:04:41.058244 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 220/443] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:40 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:41.082853 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:41.083640 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:41.100274 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:41.100769 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:41.101577 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:41.102023 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:41.171735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 HTTP/1.1 Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:04:41.173410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:04:41.174724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '4728bbe3-835f-4432-b8a2-bd1ff5352341'} Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:04:41.175495 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:04:41.176848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:04:41.177905 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:04:41.187337 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f4146e33-40f6-4c2f-83c6-8d441ac78a56 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 404 len: 111 microversion: 2.1 time: 0.152502 Jun 22 09:04:41.193528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 224/444] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:41 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:04:41.201528 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fbfc3e81-4cdd-475b-82d0-5b66512171fd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '.version_select at 0x7fb332099ca0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:41.308303 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fbfc3e81-4cdd-475b-82d0-5b66512171fd tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835834285" status: 202 len: 0 microversion: 2.1 time: 0.112751 Jun 22 09:04:41.309005 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 221/445] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 09:04:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835834285 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:04:42.083970 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:42.083970 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:42.084718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:42.084718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:42.085208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:42.085208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:42.085208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:42.085208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:42.113031 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:42.113781 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:42.115491 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:42.116048 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:42.428856 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:42.437524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:42.437772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:42.440665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:42.441132 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-23b2f707-fa92-4b32-b9a1-5ac874cb1245 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.384308 Jun 22 09:04:42.454311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 225/446] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:42 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:42.454652 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b7399519-5e35-4bcc-a898-1d6860d9c2e9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.376448 Jun 22 09:04:42.454652 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 222/447] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:42 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:43.023277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fb736372-fcd9-432b-b386-693bc591fbe2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: .version_select at 0x7fb3320829d0>, body: {"keypair": {"name": "tempest-keypair-1776918536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJci/4Jk0ljR702fWGN4wvWTmthWS+x0Nk9IfRl2wMSyeAhBox2uuTVUnmese8DVSTCA2Y+mfWqKcMyeaPZsFcmQ4zlXSrg9dEwc/KfcKn8up2xctmDwHQENvoS/dy2Mqw=="}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:43.037860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-fb736372-fcd9-432b-b386-693bc591fbe2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:04:43.041720 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-fb736372-fcd9-432b-b386-693bc591fbe2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:04:43.171662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fb736372-fcd9-432b-b386-693bc591fbe2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152081 Jun 22 09:04:43.172466 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 226/448] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:04:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:43.461788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:43.462608 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:43.466122 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:43.467811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:43.473705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:43.474436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:43.493714 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:43.493900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:43.493987 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:43.494160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:43.494257 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:43.494257 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:43.692546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:43.705852 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:43.709179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:43.712203 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:43.714684 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c017fe7c-d034-449c-9422-6eb6a353b716 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.256619 Jun 22 09:04:43.715212 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7d342267-f6d3-4c48-9e01-0f8e0f194c7f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.254102 Jun 22 09:04:43.715615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 223/449] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:43 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:43.732918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 227/450] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:43 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:44.735178 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:44.735838 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:44.742885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:44.744090 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:44.746254 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:44.746715 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:44.747852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:44.748032 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:44.750976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:44.752652 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:44.752652 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:44.752866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:44.757213 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:44.959869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:44.963393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:44.968876 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:44.970398 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:44.971592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0c17f0df-2a4f-4032-ba50-53fc713b0cb3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.240421 Jun 22 09:04:44.972140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 224/451] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:44 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:44.976699 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a38cb580-334a-47ff-bc14-3731c9ad4184 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.238025 Jun 22 09:04:44.977282 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 228/452] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:44 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:45.704793 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c01eec1b-7f27-4b8f-9a1e-21d4b9c90263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Action: 'create', calling method: .version_select at 0x7fb331fe2820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-289684474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH9tbdGMxEVDKTLkCVlcuobg2eqzu8+c245CWzhwp/MerwQZZwMsX5o8MeoN5FpXsyK//sowZbFjqku0XyI/v7gqeko3jigi5haTRs03IA7lFAFxroBKr4+4Rn0ogHwYQ=="}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:45.720260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-c01eec1b-7f27-4b8f-9a1e-21d4b9c90263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Getting quotas for project 85bf3e1b89094cafa7d469ed3f84eb36. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:04:45.724165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-c01eec1b-7f27-4b8f-9a1e-21d4b9c90263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Getting quotas for user 448ee30440fb46779216649dd6907331 and project 85bf3e1b89094cafa7d469ed3f84eb36. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:04:45.871417 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c01eec1b-7f27-4b8f-9a1e-21d4b9c90263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.170484 Jun 22 09:04:45.872113 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 225/453] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:04:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:04:45.923363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1554279483", "imageRef": "4926389c-e975-46f2-bb60-6caf868ea809", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-289684474", "networks": [{"uuid": "b1bae75a-b52c-4aa8-a997-6a3f2f298256"}]}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:45.977378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] validate_networks() for [('b1bae75a-b52c-4aa8-a997-6a3f2f298256', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:04:45.990618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:45.991546 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:46.015318 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:46.015760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:46.016542 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:46.016964 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:46.242302 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:46.253564 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:46.255520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:46.257011 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c7643e8c-e5f1-4a1f-af68-e27957fdfc5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1738 microversion: 2.20 time: 0.270717 Jun 22 09:04:46.257799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 226/454] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:45 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:46.262903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:46.267642 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:46.271491 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:46.271988 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:46.272836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:46.273328 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:46.590989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:46.600306 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d7e6b4e9-8d71-40a2-b4a9-389963b55b94 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.341356 Jun 22 09:04:46.600980 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 227/455] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:46 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:46.606508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-799314732", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89fc451c-46b3-4008-9c5d-bc37135b61a8"}], "security_groups": [{"name": "tempest-securitygroup--634564264"}], "key_name": "tempest-keypair-1776918536", "user_data": "}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:46.709721 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:04:46.710285 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:04:46.710866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:04:46.711292 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:04:46.711751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:04:46.721286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:46.721746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:46.722550 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:46.722983 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:46.741010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Getting quotas for project 85bf3e1b89094cafa7d469ed3f84eb36. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:04:46.746614 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Getting quotas for user 448ee30440fb46779216649dd6907331 and project 85bf3e1b89094cafa7d469ed3f84eb36. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:04:46.758747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:04:46.760995 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4926389c-e975-46f2-bb60-6caf868ea809',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:04:46.775893 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] validate_networks() for [('89fc451c-46b3-4008-9c5d-bc37135b61a8', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:04:46.968952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bc292cbd-7916-4e5c-864e-35bcb7133b0c tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050451 Jun 22 09:04:46.970222 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 229/456] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:04:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:04:46.981164 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2b18e4c2-cd7a-4547-8a77-524c6a24b1a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:46.982541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2b18e4c2-cd7a-4547-8a77-524c6a24b1a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:47.216259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2b18e4c2-cd7a-4547-8a77-524c6a24b1a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:47.223989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2b18e4c2-cd7a-4547-8a77-524c6a24b1a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1258 microversion: 2.1 time: 0.247268 Jun 22 09:04:47.224867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 230/457] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:46 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:47.276737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:47.277788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:47.284696 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:47.285459 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:47.286359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:47.286862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:47.616192 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:47.624595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:47.626106 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:47.627262 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1edd5264-9db2-463b-ae1b-520d2c2170df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1720 microversion: 2.20 time: 0.354748 Jun 22 09:04:47.627827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 231/458] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:47 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1720 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:47.639349 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:47.639349 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:47.639349 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:47.639715 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:47.640203 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:47.640634 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:47.803252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:04:47.803767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:04:47.804350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:04:47.804824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:04:47.811090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:04:47.818237 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:47.818763 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:47.819490 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:47.820113 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:47.835617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:47.846478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:04:47.846620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b7743840-175b-4dd0-8c68-5fae49e5ce67 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.216917 Jun 22 09:04:47.846620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 232/459] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:47 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:47.850673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:04:47.863316 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:04:47.865605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:04:48.105239 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d88aad5d-5e99-439d-8d8a-00478f231dc0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.502878 Jun 22 09:04:48.106082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 228/460] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:04:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:04:48.116453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6d0d043b-107b-4407-ba17-c7fe8d3ff6d9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:48.117092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6d0d043b-107b-4407-ba17-c7fe8d3ff6d9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:48.178887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6d0d043b-107b-4407-ba17-c7fe8d3ff6d9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:48.186940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6d0d043b-107b-4407-ba17-c7fe8d3ff6d9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1241 microversion: 2.1 time: 0.074301 Jun 22 09:04:48.187516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 233/461] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:48 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:48.243128 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ecb16066-7a38-493d-83e7-ff2303bb52a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:48.244500 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ecb16066-7a38-493d-83e7-ff2303bb52a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:48.301828 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ecb16066-7a38-493d-83e7-ff2303bb52a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:48.312634 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ecb16066-7a38-493d-83e7-ff2303bb52a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1258 microversion: 2.1 time: 0.073765 Jun 22 09:04:48.313638 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 229/462] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:48 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:48.650697 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:48.651316 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:48.661006 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:48.661455 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:48.662246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:48.662682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:48.806719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:48.816478 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:48.817692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:48.818919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6b3ba965-1bc1-4658-a0b5-1dd4b74ff5a8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1720 microversion: 2.20 time: 0.174791 Jun 22 09:04:48.826509 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 234/463] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:48 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:48.863837 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:48.864478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:48.871327 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:48.871776 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:48.873117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:48.873540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.016603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:49.024949 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d2b845c1-6163-40d8-af95-596ea4b61038 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.164907 Jun 22 09:04:49.025502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 230/464] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:48 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:49.204809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:49.206081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:49.214312 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:49.215032 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.216047 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:49.216781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.282933 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:49.290778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3b5d3d2c-5d24-42f2-a532-588867cec676 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1245 microversion: 2.1 time: 0.090916 Jun 22 09:04:49.291341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 235/465] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:49 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:49.330512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:49.331130 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:49.337852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:49.338284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.339088 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:49.339609 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.406993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:49.414932 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-500de726-1a34-4109-bd1b-6d7abcaf63bd tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1262 microversion: 2.1 time: 0.088605 Jun 22 09:04:49.416175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 231/466] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:49 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:49.589583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-03db605e-2385-48d5-8bd1-f5697e93e254 req-679f60b0-cd76-4572-9d71-88c718497811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570dea14-f80c-45cc-9935-7cf6d445d337", "name": "network-vif-unplugged", "status": "completed", "tag": "be31663b-fa96-458a-8d8e-4d90d98f36db"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:49.599602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-03db605e-2385-48d5-8bd1-f5697e93e254 req-679f60b0-cd76-4572-9d71-88c718497811 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:49.600046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-03db605e-2385-48d5-8bd1-f5697e93e254 req-679f60b0-cd76-4572-9d71-88c718497811 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.622100 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-03db605e-2385-48d5-8bd1-f5697e93e254 req-679f60b0-cd76-4572-9d71-88c718497811 service nova] Creating event network-vif-unplugged:be31663b-fa96-458a-8d8e-4d90d98f36db for instance 570dea14-f80c-45cc-9935-7cf6d445d337 on hv-cinder-78729 Jun 22 09:04:49.632125 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-03db605e-2385-48d5-8bd1-f5697e93e254 req-679f60b0-cd76-4572-9d71-88c718497811 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046713 Jun 22 09:04:49.632798 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 236/467] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:49.842765 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:49.843461 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:49.849664 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:49.850131 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.850885 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:49.851317 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:49.997700 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:50.007005 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:50.008733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:50.009873 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2e2b7f20-be9b-40ea-89ad-4dab24a1a513 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1723 microversion: 2.20 time: 0.175818 Jun 22 09:04:50.010482 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 232/468] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:49 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:50.030754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1905d29f-83f7-484d-9525-b1e442d151e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17c5b930-2a9d-4c2a-a345-56daddf177af"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:50.031917 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1905d29f-83f7-484d-9525-b1e442d151e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:50.038450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1905d29f-83f7-484d-9525-b1e442d151e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.038902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1905d29f-83f7-484d-9525-b1e442d151e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.039677 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1905d29f-83f7-484d-9525-b1e442d151e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.040116 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1905d29f-83f7-484d-9525-b1e442d151e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.047247 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:50.047855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:50.055289 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.055738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.056513 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.056948 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.203276 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:50.212561 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1b279f97-d581-4c98-89c3-19390cb23da5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.169771 Jun 22 09:04:50.213018 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 233/469] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:50 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:50.311447 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:50.312069 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:50.318531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.318986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.319763 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.320200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.396410 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:50.405239 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-605ed4d8-fa11-4bf8-859f-48539d99292c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1293 microversion: 2.1 time: 0.098872 Jun 22 09:04:50.405748 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 234/470] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:50 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:50.432751 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:50.433408 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:50.440630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.441088 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.441845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:50.442349 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:50.506538 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:50.515694 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-49507887-d154-4282-a06a-5ac4e7d6c663 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1318 microversion: 2.1 time: 0.086757 Jun 22 09:04:50.516405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 235/471] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:50 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:51.235705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:51.236814 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:51.244498 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.244950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.246276 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.246771 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.301456 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1905d29f-83f7-484d-9525-b1e442d151e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.275559 Jun 22 09:04:51.303134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 237/472] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Jun 22 09:04:50 2022] POST /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments => generated 188 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:04:51.428250 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:51.429711 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:51.453455 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.453924 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.457735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.458231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.600447 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:51.609103 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5c2c7ef2-a911-485c-8739-43b6f222ff9a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1299 microversion: 2.1 time: 0.190013 Jun 22 09:04:51.609686 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 238/473] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:51 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:51.614285 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7c76cabc-6724-41b3-b7ba-2769831c51c1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:51.614845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7c76cabc-6724-41b3-b7ba-2769831c51c1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:51.624993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:51.631876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7c76cabc-6724-41b3-b7ba-2769831c51c1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.632322 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7c76cabc-6724-41b3-b7ba-2769831c51c1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.638220 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7c76cabc-6724-41b3-b7ba-2769831c51c1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.638220 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7c76cabc-6724-41b3-b7ba-2769831c51c1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.638687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5dbccf5f-433a-43b5-aa2e-1c0c0762bf25 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.404657 Jun 22 09:04:51.638687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 236/474] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:51 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:51.651342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:51.652261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:51.660026 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.660849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.661857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:51.662572 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:51.684232 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:51.801572 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:51.822171 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9116250f-7162-4bf2-b8f2-c4d2b04a83be tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1316 microversion: 2.1 time: 0.183079 Jun 22 09:04:51.824352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 237/475] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:51 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:52.056453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7c76cabc-6724-41b3-b7ba-2769831c51c1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/action" status: 202 len: 0 microversion: 2.20 time: 0.445611 Jun 22 09:04:52.059673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 239/476] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 09:04:51 2022] POST /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:04:52.080110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:52.087871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:52.105825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.106568 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:52.108944 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.111630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:52.619984 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:52.631844 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:52.632613 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:52.645241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:52.649600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:52.654673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2a80b176-7189-4f47-9cb8-70e8f65ef45d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1749 microversion: 2.20 time: 0.585565 Jun 22 09:04:52.657081 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 238/477] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:52 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1749 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:52.662525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.663368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:52.664221 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:52.665319 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:52.671873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.676569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:52.676734 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.676734 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:52.678279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.681529 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:52.882225 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:52.894287 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b3f1c453-0972-4c33-b321-2fea44161db6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1299 microversion: 2.1 time: 0.269361 Jun 22 09:04:52.894864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 240/478] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:52 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:52.899695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:52.900537 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:52.911380 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.912265 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:52.913313 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:52.914026 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:53.126364 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:53.142668 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9f235972-d3e9-4403-82d0-a1b1e8760bf8 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.484087 Jun 22 09:04:53.143683 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 239/479] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:52 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:53.345937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:53.361171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-88ed82d5-2959-43b5-9932-7b7f22fe43fc tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.464685 Jun 22 09:04:53.368682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 241/480] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:52 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:53.682110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:53.683706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:53.703318 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:53.703816 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:53.705040 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:53.705763 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:53.914577 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:53.915127 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:53.918036 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:53.933196 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:53.933674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:53.937370 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:53.938795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:54.349221 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:54.359983 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:54.361482 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:54.363136 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-064d21da-8a6d-4d8a-86f9-efe0af43f7bb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1749 microversion: 2.20 time: 0.689783 Jun 22 09:04:54.374369 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 240/481] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:53 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1749 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:54.374369 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:54.374369 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:54.389226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:54.389673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:54.390492 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:54.390930 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:54.902584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:54.911873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d92d3a79-fa0c-4952-a930-53fdf692f3ec tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 1.001824 Jun 22 09:04:54.922421 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 242/482] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:53 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:54.928684 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:54.929634 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:54.938609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:54.939482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:54.940456 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:54.940964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:55.184039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:55.222831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-bb7f2f41-4b69-4f88-9bab-ad11052619f6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.857643 Jun 22 09:04:55.224376 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 241/483] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:54 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:55.236470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-c1a662fc-913a-42fc-891f-f89462b4e341 req-64508a04-f23b-4a21-bb38-0701e5e9215b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af5fd5f-bacb-4b11-87e5-775523e12208", "tag": "999fae5e-5944-444b-a551-890daaa2af68"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:55.246924 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-c1a662fc-913a-42fc-891f-f89462b4e341 req-64508a04-f23b-4a21-bb38-0701e5e9215b service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:55.249044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-c1a662fc-913a-42fc-891f-f89462b4e341 req-64508a04-f23b-4a21-bb38-0701e5e9215b service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:55.269098 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-c1a662fc-913a-42fc-891f-f89462b4e341 req-64508a04-f23b-4a21-bb38-0701e5e9215b service nova] Creating event network-changed:999fae5e-5944-444b-a551-890daaa2af68 for instance 6af5fd5f-bacb-4b11-87e5-775523e12208 on hv-cinder-78729 Jun 22 09:04:55.276219 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-c1a662fc-913a-42fc-891f-f89462b4e341 req-64508a04-f23b-4a21-bb38-0701e5e9215b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048862 Jun 22 09:04:55.278403 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 242/484] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:55.383325 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:55.384377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:55.398918 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:55.399637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:55.403287 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:55.407148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:55.416174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:55.429179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-37b05f82-c52b-4b51-9404-aff99cbce76e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.504639 Jun 22 09:04:55.430036 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 243/485] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:54 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:55.821848 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:55.836670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:55.839310 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:55.840815 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b5b2a568-4f69-4ad3-bdbd-da2354766031 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1749 microversion: 2.20 time: 0.462084 Jun 22 09:04:55.842285 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 243/486] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:55 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1749 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:55.930678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:55.937706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:55.943636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:55.944444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:55.945660 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:55.946337 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:55.979530 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:56.246877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:56.249205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:56.258863 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:56.259836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:56.260853 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:56.261705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:56.320848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:56.333528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6851c253-4d4b-4009-9543-23de7e4b6ef0 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.406976 Jun 22 09:04:56.344755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 244/487] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:55 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:56.462434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:56.465603 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:56.481301 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:56.482462 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:56.483542 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:56.484234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:56.733781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:56.742254 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:56.751813 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b5574f07-0bda-4d5b-9233-f61caee83a8d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.510668 Jun 22 09:04:56.752684 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 244/488] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:56 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:56.864432 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:56.865339 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:56.884956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:56.890138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:56.890138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:56.890138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:56.890138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:56.973507 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:56.986706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-130820cd-5f03-4af4-beb5-813e6716b2d3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.536401 Jun 22 09:04:56.998831 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 245/489] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:56 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:57.196161 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:57.205836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:57.207818 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:57.209199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dfb27f34-20a3-4aee-bd04-3559b51f79e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1751 microversion: 2.20 time: 0.352189 Jun 22 09:04:57.225152 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 245/490] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:56 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1751 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:04:57.352351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:57.353694 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:57.387767 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:57.394821 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-ccd45c38-761d-4033-ad4b-6e7de651a07e req-6e4159eb-0176-45d3-9dab-dd673ca91d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f943d146-cb3d-4f92-816a-536fc8e77c88", "tag": "51a5ee08-b678-4117-ae2e-a4b0a95533aa"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:04:57.467191 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:57.467191 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:57.467191 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:57.468616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-ccd45c38-761d-4033-ad4b-6e7de651a07e req-6e4159eb-0176-45d3-9dab-dd673ca91d89 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:57.468616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-ccd45c38-761d-4033-ad4b-6e7de651a07e req-6e4159eb-0176-45d3-9dab-dd673ca91d89 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:57.468616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-ccd45c38-761d-4033-ad4b-6e7de651a07e req-6e4159eb-0176-45d3-9dab-dd673ca91d89 service nova] Creating event network-changed:51a5ee08-b678-4117-ae2e-a4b0a95533aa for instance f943d146-cb3d-4f92-816a-536fc8e77c88 on hv-cinder-78729 Jun 22 09:04:57.468616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-ccd45c38-761d-4033-ad4b-6e7de651a07e req-6e4159eb-0176-45d3-9dab-dd673ca91d89 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061644 Jun 22 09:04:57.468616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 246/491] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:04:57.680280 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:57.690909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c09ef9a5-cd4e-48aa-bc1b-b6b05bcb805f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.342823 Jun 22 09:04:57.702848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 246/492] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:57 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:57.774657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:57.775619 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:57.783623 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:57.784474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:57.785454 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:57.786094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:57.830799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:58.043890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:58.044034 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:58.044034 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:58.044614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-34a9aada-712f-4a80-9c5c-a22a3bfbff87 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.243139 Jun 22 09:04:58.044614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 247/493] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:57 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:58.044786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:58.044786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:58.044786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:58.044786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:58.183159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=14 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:58.221347 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:58.234861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e77302b4-44a1-4a4f-ba1b-7c0746755a7a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.233569 Jun 22 09:04:58.235079 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:58.235725 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:58.236228 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 247/494] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:57 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:58.244466 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:58.245166 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:58.246162 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:58.246604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:58.306177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=12 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:58.417209 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:58.428627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:58.430460 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:58.431708 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c8dd4058-8a22-43fe-8cfc-423cb4716bbe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1751 microversion: 2.20 time: 0.202851 Jun 22 09:04:58.445615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 248/495] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:58 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:58.713897 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:58.715184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:58.722551 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:58.723017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:58.723787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:58.724256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:58.904842 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:58.915719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ae90743e-1f54-4561-9a25-f4a04ad6a543 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.207237 Jun 22 09:04:58.916794 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 248/496] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:58 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:59.059302 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:59.061900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:59.070202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.071214 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:59.072160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.072635 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:59.253493 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:59.260962 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:59.264106 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:59.272418 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.272896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:59.274039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f479f07d-a8fc-4b5e-bcaf-2ecba0c07d9e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.219181 Jun 22 09:04:59.274575 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.275052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:59.275719 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 249/497] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:59 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:04:59.444347 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:59.454035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:59.454035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:59.458647 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-769c2aff-296e-44d8-b6fa-c868689886df tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.209473 Jun 22 09:04:59.462148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.462605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:59.463391 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.463857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:59.466787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 249/498] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:59 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:04:59.633699 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:59.644217 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:59.645812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:04:59.647010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-104ff855-cf80-4fae-98f2-20522e8f222a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1751 microversion: 2.20 time: 0.198487 Jun 22 09:04:59.647564 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 250/499] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:04:59 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:04:59.935771 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:04:59.936412 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:04:59.942930 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.943377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:04:59.944134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:04:59.944553 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:00.097942 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:00.105670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9a3b17f5-431e-487f-bf47-483ae45c5fb6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.174358 Jun 22 09:05:00.106273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 250/500] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:04:59 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:00.293359 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:00.293982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:00.301213 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:00.301661 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:00.302463 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:00.302982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:00.445641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:00.459685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4688c0b3-d565-4816-85b8-b63b1bf71c53 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.169952 Jun 22 09:05:00.460687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 251/501] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:00 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:00.475722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:00.476328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:00.483232 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:00.483745 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:00.484541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:00.484971 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:00.631328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:00.639990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-45535054-357a-47bd-9c15-6a87c2e8c360 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.167351 Jun 22 09:05:00.640789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 251/502] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:00 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:00.665594 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:00.666241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:00.673079 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:00.673550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:00.674353 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:00.674790 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:01.010161 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:01.020148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:01.021714 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:01.022994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fbea4831-734d-43f2-874d-83e2b21894c8 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1751 microversion: 2.20 time: 0.362062 Jun 22 09:05:01.024093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 252/503] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:00 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1751 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:01.123170 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:01.124113 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:01.130989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:01.134636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:01.134636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:01.134636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:01.283969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:01.291883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ff69769d-8995-4903-8dad-fa6438be34a8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.172844 Jun 22 09:05:01.292450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 252/504] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:01 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:01.485703 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:01.486590 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:01.493971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:01.494857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:01.495199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:01.495713 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:01.637057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:01.649267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b7e08bc4-14e5-4fa5-8e98-7d2c59476f4d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.167734 Jun 22 09:05:01.655633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 253/505] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:01 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:01.657869 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:01.658704 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:01.665405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:01.665845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:01.666665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:01.667094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:01.805344 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:01.813417 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fd9e09c8-c0a3-40e8-80c7-1a93c49b9679 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.160369 Jun 22 09:05:01.813993 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 253/506] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:01 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:02.043044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:02.043487 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:02.049892 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.050723 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:02.051777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.051777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:02.184975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:02.193711 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:02.195225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:02.196358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d8b725b6-8868-43a2-801b-8ebb37b7159c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1751 microversion: 2.20 time: 0.157403 Jun 22 09:05:02.196911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 254/507] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:02 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:02.312747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:02.313472 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:02.319951 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.320391 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:02.321138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.321563 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:02.455785 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:02.463636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-14b6cc0f-7db2-4446-9df1-1f7d2841d39c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.155478 Jun 22 09:05:02.468847 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 254/508] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:02 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:02.666436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:02.666952 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:02.674321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.674767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:02.675519 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.675950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:02.695686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:02.888293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:02.888979 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:02.895425 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.895868 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:02.896837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:02.897299 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:03.230563 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:03.243768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0a77208a-b046-4ce3-9d2c-ce09b316752f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.581136 Jun 22 09:05:03.244602 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 255/509] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:02 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:03.249022 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:03.249919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:03.256927 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:03.257799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:03.258730 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:03.259245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:03.268140 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:03.277036 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9e68c90b-1b28-417b-b04e-42a2744ae740 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.392296 Jun 22 09:05:03.277617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 255/510] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:02 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:03.415209 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:03.423966 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:03.425496 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:03.426693 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ddc85de9-1c6a-439c-9e90-de8a2e458531 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.181394 Jun 22 09:05:03.427250 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 256/511] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:03 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:03.480820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:03.481431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:03.489150 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:03.489891 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:03.490697 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:03.491129 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:03.782833 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:03.791865 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-52626427-b524-4943-b5f8-c45f08be6ebc tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.315127 Jun 22 09:05:03.802422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 256/512] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:03 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:04.269507 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:04.270248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:04.276777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.277411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.278541 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.279120 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.301427 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:04.303474 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:04.315810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.318171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.319885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.320624 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.580025 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:04.589758 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-42958109-c0a5-4cdc-8293-bbfab52ed14d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.325165 Jun 22 09:05:04.590649 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 257/513] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:04 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:04.594446 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:04.596150 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:04.596862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:04.603375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.603826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.604934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.605226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-990264c9-4e42-4a77-b90b-2b122608b84d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.310515 Jun 22 09:05:04.605357 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.605922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 257/514] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:04 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:04.753476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:04.763136 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:04.765703 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:04.769039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e9ac8b98-e965-46e4-9596-0fad0c852ed5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.175467 Jun 22 09:05:04.769039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 258/515] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:04 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:04.810224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:04.810824 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:04.817623 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.818929 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.818929 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:04.819272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:04.962322 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:04.976712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-69dd7a61-5fc3-4bc6-9a74-8a056a9a30a6 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.164181 Jun 22 09:05:04.976712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 258/516] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:04 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:05.625208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:05.673942 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:05.674264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:05.674264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:05.674264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:05.674957 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:05.674957 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:05.675110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:05.675110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:05.675266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:05.675341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:05.675418 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:05.965708 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:05.985633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ceb72194-6fb9-4202-85c3-5273df87da62 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.364240 Jun 22 09:05:05.999651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 259/517] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:05 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:06.006277 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:06.007327 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:06.014608 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:06.016252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:06.017269 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:06.017920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:06.027695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:06.045177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fd673f79-4e00-44bf-9f53-359153997b08 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.423279 Jun 22 09:05:06.045177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 259/518] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:05 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:06.057474 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:06.059162 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:06.066895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:06.067351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:06.068324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:06.069352 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:06.293184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:06.308964 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:06.311443 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:06.315028 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-60c6b4a5-940a-4249-89de-dff03d3b41d5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.314008 Jun 22 09:05:06.330806 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 260/519] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:05 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:06.334613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-92d8d93d-ac84-42d4-862a-332276f92968 req-10bfec92-6b31-4aa4-a0d1-dda0e2f431e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f943d146-cb3d-4f92-816a-536fc8e77c88", "name": "network-vif-plugged", "status": "completed", "tag": "51a5ee08-b678-4117-ae2e-a4b0a95533aa"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:06.347904 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-92d8d93d-ac84-42d4-862a-332276f92968 req-10bfec92-6b31-4aa4-a0d1-dda0e2f431e0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:06.348881 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-92d8d93d-ac84-42d4-862a-332276f92968 req-10bfec92-6b31-4aa4-a0d1-dda0e2f431e0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:06.352175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:06.362211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8084832a-85e1-4e33-b320-58533f21d090 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.310618 Jun 22 09:05:06.363901 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 260/520] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:06 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:06.365618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-92d8d93d-ac84-42d4-862a-332276f92968 req-10bfec92-6b31-4aa4-a0d1-dda0e2f431e0 service nova] Creating event network-vif-plugged:51a5ee08-b678-4117-ae2e-a4b0a95533aa for instance f943d146-cb3d-4f92-816a-536fc8e77c88 on hv-cinder-78729 Jun 22 09:05:06.371545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-92d8d93d-ac84-42d4-862a-332276f92968 req-10bfec92-6b31-4aa4-a0d1-dda0e2f431e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042061 Jun 22 09:05:06.372382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 261/521] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:07.007498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:07.008411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:07.015650 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.016092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.016895 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.017322 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.023416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:07.064414 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:07.065121 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:07.074174 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.074884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.075860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.076957 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.237000 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:07.246088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-eb48a008-0c14-429b-a8fd-88fda958a227 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.242992 Jun 22 09:05:07.257015 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 261/522] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:07 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:07.344588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:07.344987 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:07.345699 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:07.360124 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b07d07a7-699d-452b-a614-662a71795d4f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.300852 Jun 22 09:05:07.367424 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.367880 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.368698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.369133 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.370806 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 262/523] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:07 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:07.380770 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:07.381294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:07.388759 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.389466 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.390974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:07.391970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:07.603915 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:07.617553 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:07.619306 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:07.620625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9d923d53-7c5a-4d58-8673-700379271596 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.287291 Jun 22 09:05:07.632191 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 262/524] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:07 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:07.661382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:07.670794 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ab970171-9b7f-401b-a0fb-08f99efed9a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.293892 Jun 22 09:05:07.672430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 263/525] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:07 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:08.270619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:08.270619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:08.283287 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.284152 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.285728 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.286567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.396160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:08.397092 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:08.410402 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.411416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.412555 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.413168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.505185 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:08.516609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-59e7e956-3051-49c6-a424-c73f8aa01b49 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.255083 Jun 22 09:05:08.517739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 263/526] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:08 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:08.523068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-e2e4bf72-e212-4396-a763-b729afa174a1 req-60f54916-33ac-40dd-aa37-6d0070357615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af5fd5f-bacb-4b11-87e5-775523e12208", "name": "network-vif-plugged", "status": "completed", "tag": "999fae5e-5944-444b-a551-890daaa2af68"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:08.531351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-e2e4bf72-e212-4396-a763-b729afa174a1 req-60f54916-33ac-40dd-aa37-6d0070357615 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.531786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-e2e4bf72-e212-4396-a763-b729afa174a1 req-60f54916-33ac-40dd-aa37-6d0070357615 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.557632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-e2e4bf72-e212-4396-a763-b729afa174a1 req-60f54916-33ac-40dd-aa37-6d0070357615 service nova] Creating event network-vif-plugged:999fae5e-5944-444b-a551-890daaa2af68 for instance 6af5fd5f-bacb-4b11-87e5-775523e12208 on hv-cinder-78729 Jun 22 09:05:08.565897 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-e2e4bf72-e212-4396-a763-b729afa174a1 req-60f54916-33ac-40dd-aa37-6d0070357615 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046069 Jun 22 09:05:08.567246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 264/527] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:08.615126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:08.627182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dd6525a4-24f0-4528-a953-5f1ac4d604d5 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.251996 Jun 22 09:05:08.636979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 264/528] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:08 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:08.645453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:08.646177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:08.654002 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.654484 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.655286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.655738 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.691648 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:08.692788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:08.721988 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.722842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.723780 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:08.724281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:08.900690 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:08.911637 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:08.913168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:08.914402 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fa72cd09-213c-47ee-b197-8953df58528e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.275224 Jun 22 09:05:08.928633 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 265/529] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:08 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:08.932199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:08.942997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-189f8591-087a-4c97-8296-e3e6c890a42e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.257576 Jun 22 09:05:08.943974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 265/530] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:08 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:09.535770 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:09.536412 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:09.544042 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.544777 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:09.545773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.546809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:09.644714 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:09.645306 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:09.652260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.653001 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:09.654232 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.654825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:09.739173 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:09.753058 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-93744aff-47a6-4d64-add2-6fc07f7e4133 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.222587 Jun 22 09:05:09.769865 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 266/531] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:09 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:09.857768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:09.867982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8cccde5f-6506-4381-9311-fb2930961900 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.227213 Jun 22 09:05:09.878959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 266/532] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:09 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:09.936081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:09.937248 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:09.943988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.944435 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:09.945312 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.945754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:09.960316 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:09.961097 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:09.967444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.968481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:09.969275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:09.969712 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:10.211445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:10.214373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:10.224053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8eeac198-0149-420e-9ec3-452f60b11aad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.267469 Jun 22 09:05:10.230107 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 267/533] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:09 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:10.230342 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:10.233091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:10.234366 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2368762e-96e8-4aac-ae3e-bb6d2d642844 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.302190 Jun 22 09:05:10.235218 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 267/534] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:09 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:10.776935 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:10.777553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:10.793326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:10.793326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:10.800530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:10.801000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:10.885808 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:10.886604 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:10.899648 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:10.900328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:10.901553 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:10.902131 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:11.047145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:11.059090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8c22c2a2-1b01-4082-bcc1-a31d5ed8cf28 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.285996 Jun 22 09:05:11.060014 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 268/535] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:10 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:11.134649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:11.143357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a9029230-331f-48f0-8ab6-888220c65097 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.261826 Jun 22 09:05:11.144131 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 268/536] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:10 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:11.242585 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:11.243521 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:11.252151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:11.252595 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:11.253894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:11.254588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:11.254956 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:11.261262 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:11.272957 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:11.273560 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:11.274475 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:11.275115 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:11.490392 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:11.499942 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f127ce3e-8fae-4c97-8a64-13ab71d959e5 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.260520 Jun 22 09:05:11.500604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 269/537] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:11 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:11.520866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:11.531008 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:11.532906 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:11.534148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8f49ca05-3470-4003-bdfd-71ca145d4ddd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.284815 Jun 22 09:05:11.542248 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 269/538] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:11 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:12.080937 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:12.081638 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:12.090232 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.090682 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.091594 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.092211 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.162388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:12.163815 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:12.170853 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.171845 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.173109 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.173313 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.329319 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:12.338335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-94e1bc1b-649b-4106-8c7d-53bf6b43631c tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.261222 Jun 22 09:05:12.338814 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 270/539] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:12 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:12.391541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:12.399425 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-cc17e141-1f37-436b-988c-db2ba89970d4 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.241876 Jun 22 09:05:12.399989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 270/540] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:12 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:12.517256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:12.517908 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:12.524461 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.524901 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.525662 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.526124 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.553303 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:12.567734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:12.567734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.567734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.567734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:12.568195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:12.720576 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:12.731688 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fe47ead7-59d9-4b70-b5b2-a33666f148e1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.218576 Jun 22 09:05:12.732420 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 271/541] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:12 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:12.747268 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:12.756877 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:12.758379 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:12.759552 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2c6dca42-2061-4d3e-863c-47c7a88bec5b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.210313 Jun 22 09:05:12.760110 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 271/542] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:12 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:05:13.357285 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:13.357980 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:13.365844 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.366373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:13.367138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.367572 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:13.416833 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:13.417428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:13.426889 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.427422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:13.428317 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.428751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:13.898313 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:13.901358 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:13.901979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:13.907260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-78a91441-12a0-42e9-8833-4f04aeb45a2d tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.553854 Jun 22 09:05:13.907887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 272/543] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:13 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:13.909334 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a3d1c24c-380d-44ab-b2ae-2c4fd428187a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.496409 Jun 22 09:05:13.910214 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 272/544] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:13 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:13.912526 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:13.913137 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:13.919742 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.920187 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:13.920964 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.921405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:13.924148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:13.924767 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:13.930942 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.931391 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:13.932157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:13.932590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:14.121368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:14.124952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:14.130020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f53bde49-4485-4d66-b04a-143eafb94937 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.221061 Jun 22 09:05:14.130628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 273/545] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:13 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:14.134252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:14.135753 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:14.136904 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1e0e49b7-53c3-4f0e-b7fd-fbb1e779807b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.216796 Jun 22 09:05:14.137448 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 273/546] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:13 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:14.926108 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:14.926727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:14.926881 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:14.927449 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:14.934169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:14.934357 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:14.934620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:14.934736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:14.935383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:14.935493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:14.935818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:14.935967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:15.134146 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:15.136832 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:15.142870 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d8748024-057e-4b88-a098-08339344acd2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.220178 Jun 22 09:05:15.143462 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 274/547] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:14 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:15.145782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-761d5071-dfe2-47da-89a3-059737dff753 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.224880 Jun 22 09:05:15.146605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 274/548] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:14 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:15.148443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:15.149031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:15.155301 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:15.155806 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:15.156110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:15.156574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:15.157388 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:15.157649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:15.163898 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:15.164426 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:15.165255 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:15.165753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:15.364209 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:15.368457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:15.372817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-931e1b23-b4a4-413d-bb7e-e6eb0cc3193a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1366 microversion: 2.1 time: 0.228348 Jun 22 09:05:15.373468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 275/549] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:15 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:15.378085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:15.379499 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:15.380655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9adf0146-dd78-4997-9b9f-b1cab3ed9055 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.228527 Jun 22 09:05:15.381454 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 275/550] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:15 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:16.160302 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:16.160849 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:16.163799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:16.164405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:16.167566 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.168016 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.168797 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.169238 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.171220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.171668 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.172419 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.173541 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.375614 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:16.378492 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:16.384068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-752c8324-caaf-46db-bb92-d5325e2da7d7 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1735 microversion: 2.1 time: 0.224140 Jun 22 09:05:16.384650 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 276/551] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:16 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:16.388644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b0df4e53-ffcf-4f9a-8166-f8f795806d94 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1358 microversion: 2.1 time: 0.232936 Jun 22 09:05:16.389214 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 276/552] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:16 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:16.398859 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:16.399483 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:16.405581 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.406036 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.406832 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.407690 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:16.407874 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.408694 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:16.415886 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.416376 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.417206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.417706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.611979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:16.615426 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:16.620097 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fe0cca28-a58d-4415-8c10-95165a4ecaef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1554 microversion: 2.1 time: 0.224869 Jun 22 09:05:16.620677 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 277/553] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:16 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:16.624350 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:16.625825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:16.627424 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c598e0a8-5518-4b77-874b-9a320715af76 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.224464 Jun 22 09:05:16.628003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 277/554] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:16 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:05:16.636569 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-44ffaff5-2f53-47a0-977f-5f1cd8f5b094 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:16.637067 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-44ffaff5-2f53-47a0-977f-5f1cd8f5b094 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:16.643729 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-44ffaff5-2f53-47a0-977f-5f1cd8f5b094 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.644169 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-44ffaff5-2f53-47a0-977f-5f1cd8f5b094 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.644929 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-44ffaff5-2f53-47a0-977f-5f1cd8f5b094 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:16.645366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-44ffaff5-2f53-47a0-977f-5f1cd8f5b094 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:16.724223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-44ffaff5-2f53-47a0-977f-5f1cd8f5b094 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091407 Jun 22 09:05:16.724853 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 278/555] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:05:16 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:17.400760 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:17.401974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:17.408223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:17.408921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:17.411678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.412288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.413265 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.413956 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.416151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.416151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.416547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.417163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.437511 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:17.620836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:17.624784 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:17.629125 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0757a954-4c20-4a48-9b1c-9dea288fa193 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1548 microversion: 2.1 time: 0.226797 Jun 22 09:05:17.629967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 279/556] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:17 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:17.633332 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-20611581-bcbb-42c5-a8ba-fc898763e139 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1715 microversion: 2.1 time: 0.236415 Jun 22 09:05:17.634166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 278/557] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:17 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1715 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:17.645786 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:17.647190 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:17.651899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:17.652003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:17.658359 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.659038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.659820 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.660258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.661737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.662785 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.663921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.664707 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.873756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:17.877550 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:17.888776 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2efc9442-9e34-4627-8013-7b885d1e0263 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1548 microversion: 2.1 time: 0.247214 Jun 22 09:05:17.889547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 280/558] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:17 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:17.892393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:17.892393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:17.893497 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a292bffb-4b83-41c9-9ce6-852c4049040f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.250193 Jun 22 09:05:17.894422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 279/559] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:17 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:17.905828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:17.907736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:17.908245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:17.909294 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:17.910091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Searching by: {'deleted': False, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36'} {{(pid=118028) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 09:05:17.914538 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.914991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.915769 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.916203 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.917589 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.918401 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:17.919196 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:17.919623 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.011920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] HTTP exception thrown: Cannot 'detach_volume' instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba while it is in vm_state rescued Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Request method failure captured: Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: DELETE /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments/57a18ba4-f747-48a6-8b4f-101a734fd94d HTTP/1.1 Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpESGTFaQxGtcndAFBrNLKBjja4-8WEHkQgrdwwJOcS3mOOgNl1Wt_XlYgfR-gAQ4esEgNy6I-lgmLbNqlEWaQ6B1raOj0LHh4L-H-ZidkFp5WY3reLNxIt9EqSqsyXh_ZJi0WijTJ5Ul7w36pmrdC32d1GaRA6UEsUFciKs_Ve0X4 Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:05:18.013578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}] Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: c5c6763ac1ea47da89d3bb29d630b48c Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:05:18.015167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Cannot 'detach_volume' instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba while it is in vm_state rescued Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'server_id': '3c0bc5af-2a76-4d82-a1c4-fba8eac05dba', 'id': '57a18ba4-f747-48a6-8b4f-101a734fd94d'} Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:05:18.015849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba while it is in vm_state rescued Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba while it is in vm_state rescued Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:05:18.017258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Returning 409 to user: Cannot 'detach_volume' instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba while it is in vm_state rescued {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:05:18.019817 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a479048b-df0d-430c-9888-1a873364b468 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments/57a18ba4-f747-48a6-8b4f-101a734fd94d" status: 409 len: 152 microversion: 2.1 time: 0.124664 Jun 22 09:05:18.020396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 281/560] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:05:17 2022] DELETE /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments/57a18ba4-f747-48a6-8b4f-101a734fd94d => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 09:05:18.022877 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.multi_cell_list [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118028) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 09:05:18.025459 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-7d30ffe1-4f97-4596-8fa0-28091cfcd475 req-bce763b2-6789-4b73-94dc-81f18700f2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f943d146-cb3d-4f92-816a-536fc8e77c88", "tag": "51a5ee08-b678-4117-ae2e-a4b0a95533aa"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:18.034848 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-7d30ffe1-4f97-4596-8fa0-28091cfcd475 req-bce763b2-6789-4b73-94dc-81f18700f2f0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.035295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-7d30ffe1-4f97-4596-8fa0-28091cfcd475 req-bce763b2-6789-4b73-94dc-81f18700f2f0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.045909 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-7d30ffe1-4f97-4596-8fa0-28091cfcd475 req-bce763b2-6789-4b73-94dc-81f18700f2f0 service nova] Creating event network-changed:51a5ee08-b678-4117-ae2e-a4b0a95533aa for instance f943d146-cb3d-4f92-816a-536fc8e77c88 on hv-cinder-78729 Jun 22 09:05:18.051860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-7d30ffe1-4f97-4596-8fa0-28091cfcd475 req-bce763b2-6789-4b73-94dc-81f18700f2f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030235 Jun 22 09:05:18.052444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 282/561] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:18.058845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c6f65749-f47a-4f83-9168-94766b4be005 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:18.059473 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c6f65749-f47a-4f83-9168-94766b4be005 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:18.066697 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c6f65749-f47a-4f83-9168-94766b4be005 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.067148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c6f65749-f47a-4f83-9168-94766b4be005 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.067920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c6f65749-f47a-4f83-9168-94766b4be005 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.068356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c6f65749-f47a-4f83-9168-94766b4be005 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.129688 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f4cb3eb0-8373-4195-b356-ad8c4e9277b6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227499 Jun 22 09:05:18.132517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 280/562] 10.222.0.36 () {58 vars in 1124 bytes} [Wed Jun 22 09:05:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:05:18.142029 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:18.142684 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:18.149667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.150149 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.150928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.151362 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.335437 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c6f65749-f47a-4f83-9168-94766b4be005 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "POST /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/action" status: 202 len: 0 microversion: 2.1 time: 0.281327 Jun 22 09:05:18.340092 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 283/563] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:05:18 2022] POST /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:05:18.356858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:18.359299 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:18.366375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.367633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.368735 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.369251 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.393965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:18.404164 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ff9c9644-fc65-41f1-b0ec-36bfe046eda6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1548 microversion: 2.1 time: 0.266164 Jun 22 09:05:18.417581 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 281/564] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:18 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1548 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:18.578686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:18.592114 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ebb6f793-de71-4968-b29a-179693728953 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1723 microversion: 2.1 time: 0.243403 Jun 22 09:05:18.593947 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 284/565] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:18 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:18.913305 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:18.913920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:18.921330 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.921558 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:18.922410 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:18.923812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:19.072389 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:19.081453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:19.083213 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:19.084360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1f8fb966-d7b5-4270-b0b6-1f859b640967 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.175075 Jun 22 09:05:19.084932 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 282/566] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:18 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:19.611685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:19.612256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:19.619390 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:19.619839 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:19.620629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:19.621067 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:19.835986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:19.845375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1d1848e1-5aa0-4fb0-a15e-c4288299e7b3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1723 microversion: 2.1 time: 0.237398 Jun 22 09:05:19.846044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 285/567] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:19 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:20.103250 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:20.103896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:20.110931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:20.111372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:20.112136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:20.112625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:20.249969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:20.259436 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:20.260952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:20.262166 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c2e7e5bc-382a-4a93-aff3-77579eb98c6e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.162877 Jun 22 09:05:20.262687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 283/568] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:20 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:20.794040 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a9c8411c-0058-4596-8b74-74d7ba513a21 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e4f2aeb-e326-4375-9bae-5c7490e99c75"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:20.795231 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a9c8411c-0058-4596-8b74-74d7ba513a21 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:20.803284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9c8411c-0058-4596-8b74-74d7ba513a21 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:20.803736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9c8411c-0058-4596-8b74-74d7ba513a21 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:20.804510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9c8411c-0058-4596-8b74-74d7ba513a21 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:20.804965 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a9c8411c-0058-4596-8b74-74d7ba513a21 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:20.871878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:20.872809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:20.879548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:20.880124 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:20.880908 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:20.881441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:21.029268 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:21.038510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-04166cb6-3479-4666-9919-146a71583006 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1723 microversion: 2.1 time: 0.170246 Jun 22 09:05:21.039090 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 284/569] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:20 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:21.281102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:21.281737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:21.288632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:21.288632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:21.289394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:21.289820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:21.429761 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:21.438752 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:21.440383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:21.441539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-11cd6403-2ccf-4d66-b47d-f130d5bd1aed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.164464 Jun 22 09:05:21.442169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 285/570] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:21 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:05:22.055887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:22.056529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:22.062507 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:22.062944 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:22.063766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:22.064188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:22.206914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:22.215026 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-35e27758-9a53-480e-9aa5-ae8d94fd307b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1723 microversion: 2.1 time: 0.163007 Jun 22 09:05:22.216133 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 286/571] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:22 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:22.270856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a9c8411c-0058-4596-8b74-74d7ba513a21 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.480155 Jun 22 09:05:22.276105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 286/572] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:05:20 2022] POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments => generated 194 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:22.460399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:22.461014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:22.468468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:22.468811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:22.469781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:22.470408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:22.615542 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:22.624133 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:22.625637 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:22.627397 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f47a9a92-2a10-4e02-b3f8-809673a6224e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.171043 Jun 22 09:05:22.627964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 287/573] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:22 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:23.233149 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:23.234317 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:23.241199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:23.243834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:23.243834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:23.243834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:23.381824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:23.390699 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4a67c878-de34-4e65-bdc7-e6bd907d05cb tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1729 microversion: 2.1 time: 0.162061 Jun 22 09:05:23.391787 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 287/574] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:23 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:23.408434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5d055e89-2c35-4e87-a909-7524f06ca5db tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:23.408937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5d055e89-2c35-4e87-a909-7524f06ca5db tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:23.415356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5d055e89-2c35-4e87-a909-7524f06ca5db tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:23.415810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5d055e89-2c35-4e87-a909-7524f06ca5db tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:23.416610 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5d055e89-2c35-4e87-a909-7524f06ca5db tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:23.417044 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5d055e89-2c35-4e87-a909-7524f06ca5db tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:23.498672 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5d055e89-2c35-4e87-a909-7524f06ca5db tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094959 Jun 22 09:05:23.499263 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 288/575] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:05:23 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:23.645110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:23.646184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:23.653232 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:23.653766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:23.654655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:23.655459 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:23.661047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:23.721569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-022c157c-b967-4249-af7e-997495649d09 req-fef49922-56d0-488d-8ef0-fdf8e83d20c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570dea14-f80c-45cc-9935-7cf6d445d337", "name": "network-vif-plugged", "status": "completed", "tag": "be31663b-fa96-458a-8d8e-4d90d98f36db"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:23.736898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-022c157c-b967-4249-af7e-997495649d09 req-fef49922-56d0-488d-8ef0-fdf8e83d20c1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:23.737713 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-022c157c-b967-4249-af7e-997495649d09 req-fef49922-56d0-488d-8ef0-fdf8e83d20c1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:23.750359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-022c157c-b967-4249-af7e-997495649d09 req-fef49922-56d0-488d-8ef0-fdf8e83d20c1 service nova] Creating event network-vif-plugged:be31663b-fa96-458a-8d8e-4d90d98f36db for instance 570dea14-f80c-45cc-9935-7cf6d445d337 on hv-cinder-78729 Jun 22 09:05:23.756424 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-022c157c-b967-4249-af7e-997495649d09 req-fef49922-56d0-488d-8ef0-fdf8e83d20c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Jun 22 09:05:23.757498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 289/576] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:23.804210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:23.814515 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:23.816179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:23.817352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9440be58-6304-4d64-a694-df4e56c42a6b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.176532 Jun 22 09:05:23.818267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 288/577] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:23 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:24.530642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-7f7777bf-bdad-4d07-bfef-1d4dac190332 req-d5c75380-4fc1-4c0e-817f-50df2dd5e861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0bc5af-2a76-4d82-a1c4-fba8eac05dba", "tag": "9245704a-8d26-4a4c-af84-7c9cacbb258e"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:24.538233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=96 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:24.552517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-7f7777bf-bdad-4d07-bfef-1d4dac190332 req-d5c75380-4fc1-4c0e-817f-50df2dd5e861 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:24.556955 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-7f7777bf-bdad-4d07-bfef-1d4dac190332 req-d5c75380-4fc1-4c0e-817f-50df2dd5e861 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:24.569656 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-7f7777bf-bdad-4d07-bfef-1d4dac190332 req-d5c75380-4fc1-4c0e-817f-50df2dd5e861 service nova] Creating event network-changed:9245704a-8d26-4a4c-af84-7c9cacbb258e for instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba on hv-cinder-78729 Jun 22 09:05:24.574529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-7f7777bf-bdad-4d07-bfef-1d4dac190332 req-d5c75380-4fc1-4c0e-817f-50df2dd5e861 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050266 Jun 22 09:05:24.576608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 290/578] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:24.838222 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:24.839537 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:24.846967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:24.847413 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:24.848190 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:24.848612 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:25.060107 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:25.069139 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:25.070734 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:25.072117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a4447350-b9df-4cc5-8005-9b773b184bb7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.240284 Jun 22 09:05:25.072683 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 289/579] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:24 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:26.092283 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:26.092886 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:26.099698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:26.100140 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:26.100888 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:26.101363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:26.238969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:26.247268 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:26.248754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:26.249891 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9df2d2f0-e934-40fd-b5da-e98ae84a8e3a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.162856 Jun 22 09:05:26.250470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 291/580] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:26 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:05:26.589338 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-3c63b3e7-8058-4177-b581-5250454072c2 req-774de3f6-8ff8-4b78-b8c5-f75437e33430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0bc5af-2a76-4d82-a1c4-fba8eac05dba", "tag": "9245704a-8d26-4a4c-af84-7c9cacbb258e"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:26.598755 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-3c63b3e7-8058-4177-b581-5250454072c2 req-774de3f6-8ff8-4b78-b8c5-f75437e33430 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:26.599145 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-3c63b3e7-8058-4177-b581-5250454072c2 req-774de3f6-8ff8-4b78-b8c5-f75437e33430 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:26.610374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-3c63b3e7-8058-4177-b581-5250454072c2 req-774de3f6-8ff8-4b78-b8c5-f75437e33430 service nova] Creating event network-changed:9245704a-8d26-4a4c-af84-7c9cacbb258e for instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba on hv-cinder-78729 Jun 22 09:05:26.615357 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-3c63b3e7-8058-4177-b581-5250454072c2 req-774de3f6-8ff8-4b78-b8c5-f75437e33430 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029892 Jun 22 09:05:26.615932 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 290/581] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:27.270049 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:27.270705 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:27.277790 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:27.278288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:27.279065 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:27.279525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:27.493298 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:27.502602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:27.504167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:27.505382 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-462db0e5-e73b-4cb5-a9b3-961dfcae7f7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1807 microversion: 2.20 time: 0.240407 Jun 22 09:05:27.505932 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 292/582] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:27 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:05:28.525737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:28.526392 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:28.528384 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=92 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:28.533317 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:28.533870 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:28.534582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:28.535016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:28.672378 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:28.681067 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:28.682604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:28.683774 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6f7cd3ee-abb1-4cdf-9d79-ded7470eecfc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1794 microversion: 2.20 time: 0.163080 Jun 22 09:05:28.684324 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 291/583] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:05:28 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:05:30.903672 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:30.904287 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:30.906252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:30.912088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:30.918662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:30.918662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:30.918662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:31.051535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:31.060272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-19045f10-9764-4e56-8d07-c2153bc7a4f6 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1594 microversion: 2.1 time: 0.160363 Jun 22 09:05:31.060843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 293/584] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:30 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:33.304735 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-ba0a41c0-2f1c-4dd4-a581-906c74219dda req-c81741ae-3e37-410c-8990-7862a2842053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af5fd5f-bacb-4b11-87e5-775523e12208", "tag": "999fae5e-5944-444b-a551-890daaa2af68"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:33.313894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-ba0a41c0-2f1c-4dd4-a581-906c74219dda req-c81741ae-3e37-410c-8990-7862a2842053 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:33.314467 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-ba0a41c0-2f1c-4dd4-a581-906c74219dda req-c81741ae-3e37-410c-8990-7862a2842053 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:33.328413 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-ba0a41c0-2f1c-4dd4-a581-906c74219dda req-c81741ae-3e37-410c-8990-7862a2842053 service nova] Creating event network-changed:999fae5e-5944-444b-a551-890daaa2af68 for instance 6af5fd5f-bacb-4b11-87e5-775523e12208 on hv-cinder-78729 Jun 22 09:05:33.333784 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-ba0a41c0-2f1c-4dd4-a581-906c74219dda req-c81741ae-3e37-410c-8990-7862a2842053 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033559 Jun 22 09:05:33.341434 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 292/585] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:36.242143 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-916218320"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:36.242827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:36.249110 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:36.249550 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:36.250334 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:36.250766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:36.433395 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.network.security_group_api [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Adding security group e4383816-2a1c-4c39-8d72-93c86f94c5cb to port 999fae5e-5944-444b-a551-890daaa2af68 Jun 22 09:05:37.079795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a960207d-7d87-4482-bdcf-67f666796136 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/action" status: 202 len: 0 microversion: 2.1 time: 0.841690 Jun 22 09:05:37.080606 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 294/586] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:05:36 2022] POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/action => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:05:37.090104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:37.092172 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:37.097407 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-d2525f6d-53d8-4ca5-bcbc-1f1c429876e2 req-c027db81-de81-490a-8980-cfe66f18065a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af5fd5f-bacb-4b11-87e5-775523e12208", "tag": "999fae5e-5944-444b-a551-890daaa2af68"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:37.105980 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:37.106867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:37.107858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:37.108473 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:37.112569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-d2525f6d-53d8-4ca5-bcbc-1f1c429876e2 req-c027db81-de81-490a-8980-cfe66f18065a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:37.113911 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-d2525f6d-53d8-4ca5-bcbc-1f1c429876e2 req-c027db81-de81-490a-8980-cfe66f18065a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:37.137727 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-d2525f6d-53d8-4ca5-bcbc-1f1c429876e2 req-c027db81-de81-490a-8980-cfe66f18065a service nova] Creating event network-changed:999fae5e-5944-444b-a551-890daaa2af68 for instance 6af5fd5f-bacb-4b11-87e5-775523e12208 on hv-cinder-78729 Jun 22 09:05:37.145174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-d2525f6d-53d8-4ca5-bcbc-1f1c429876e2 req-c027db81-de81-490a-8980-cfe66f18065a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052287 Jun 22 09:05:37.147510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 295/587] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:05:37.529768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:37.539495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-292e29df-7f51-4098-952f-83caf2d055a0 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1758 microversion: 2.1 time: 0.454541 Jun 22 09:05:37.552502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 293/588] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:37 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1758 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:52.646839 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=11 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:52.647704 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=90 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:52.652564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:05:52.653609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:52.659903 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:52.666003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:52.666003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:52.666003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:52.685339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lazy-loading 'flavor' on Instance uuid c7dd4b24-61df-4868-a828-c99798580375 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:05:53.100610 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-275b728b-eea8-4d12-ba34-a6c536c9cf08 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "POST /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375/action" status: 202 len: 0 microversion: 2.1 time: 0.455018 Jun 22 09:05:53.101519 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 296/589] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:05:52 2022] POST /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:05:53.110258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:53.110856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:53.113778 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=5 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:53.114051 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=26 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:53.118821 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:53.119265 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:53.120177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:53.120640 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:53.261386 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:53.268926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-eadeaff1-153e-49de-b01e-4ae051565833 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.162720 Jun 22 09:05:53.269554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 294/590] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:53 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:54.287641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:54.288341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:54.295102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:54.295557 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:54.296301 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:54.296731 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:54.429692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:54.437940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2a048e9b-8e87-4859-a6cf-2726386f00ba tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.154495 Jun 22 09:05:54.438539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 297/591] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:54 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:55.456615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:55.457256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:55.464035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:55.464491 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:55.465926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:55.466468 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:55.604666 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:55.613031 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-777c6612-af2e-4434-a277-76e903ae5161 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.160544 Jun 22 09:05:55.613602 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 295/592] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:55 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:05:56.631730 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:56.632366 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:56.640015 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:56.640465 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:56.641272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:56.641706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:56.772669 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:56.780484 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-58d78465-6d64-46b0-b4e5-e7d130d8c1e4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.152659 Jun 22 09:05:56.781085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 298/593] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:56 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:57.797828 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:57.798489 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:57.805139 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:57.811047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:57.811047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:57.811047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:57.944034 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:57.951897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-553c83f1-1d06-43ee-80f5-f0afef28b7be tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.158894 Jun 22 09:05:57.952456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 296/594] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:57 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:05:58.968792 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:05:58.969421 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:05:58.976208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:58.976646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:58.977399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:05:58.977825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:05:59.109777 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:05:59.117223 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7ea019aa-1ac5-4600-9837-9b491b9f2bb3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.152586 Jun 22 09:05:59.117778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 299/595] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:05:58 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:00.134948 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:00.135718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:00.143024 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:00.143479 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:00.144264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:00.144705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:00.278024 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:00.286146 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5c122d5e-67ff-4dd2-9bbc-4da09f815252 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.155194 Jun 22 09:06:00.286702 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 297/596] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:00 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:01.304172 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:01.304791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:01.310904 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:01.311955 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:01.312718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:01.313163 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:01.451119 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:01.458978 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f3af4033-25a2-445f-8fc8-f04e28d90cd3 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.158907 Jun 22 09:06:01.459558 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 300/597] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:01 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:02.476251 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:02.476860 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:02.483886 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:02.484234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:02.484991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:02.485430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:02.621512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:02.629898 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2db88587-98cc-462a-8c99-d994e2addc9d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.157491 Jun 22 09:06:02.630484 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 298/598] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:02 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:02.746869 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7b949c4e-4288-4f2d-961d-f503765077b4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:02.747432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7b949c4e-4288-4f2d-961d-f503765077b4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:02.754146 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b949c4e-4288-4f2d-961d-f503765077b4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:02.754585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b949c4e-4288-4f2d-961d-f503765077b4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:02.755346 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b949c4e-4288-4f2d-961d-f503765077b4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:02.755776 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b949c4e-4288-4f2d-961d-f503765077b4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:02.778529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7b949c4e-4288-4f2d-961d-f503765077b4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/ips" status: 200 len: 148 microversion: 2.1 time: 0.090631 Jun 22 09:06:02.779076 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 301/599] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:06:02 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/ips => generated 148 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:03.647091 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:03.647637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:03.654103 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:03.654544 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:03.655294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:03.656401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:03.795632 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:03.803601 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a2caea13-92ea-4dcc-8b0f-69e5f9e71055 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.160555 Jun 22 09:06:03.804173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 299/600] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:03 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:04.415317 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c01545cf-4470-4ab1-93f7-2d5d2fd59cce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33784999-78f3-4c2b-99ed-2eb77620f07a"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:04.416510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c01545cf-4470-4ab1-93f7-2d5d2fd59cce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:04.423821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c01545cf-4470-4ab1-93f7-2d5d2fd59cce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:04.424265 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c01545cf-4470-4ab1-93f7-2d5d2fd59cce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:04.425027 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c01545cf-4470-4ab1-93f7-2d5d2fd59cce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:04.425459 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c01545cf-4470-4ab1-93f7-2d5d2fd59cce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:04.821294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:04.822000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:04.829472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:04.830019 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:04.830810 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:04.831236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:04.970011 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:04.978045 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-272719d8-8caf-4d84-b2cb-5fcbf01729df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.160566 Jun 22 09:06:04.988049 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 300/601] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:04 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:05.227933 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c01545cf-4470-4ab1-93f7-2d5d2fd59cce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816317 Jun 22 09:06:05.228585 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 302/602] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:06:04 2022] POST /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:05.612659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:05.613148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:05.619206 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:05.619649 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:05.620396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:05.620829 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:05.702245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lazy-loading 'services' on Instance uuid 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:06:05.909394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-afffbb8e-7b24-4df5-af1a-759e4048cc69 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments/57a18ba4-f747-48a6-8b4f-101a734fd94d" status: 202 len: 0 microversion: 2.1 time: 0.301130 Jun 22 09:06:05.910266 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 301/603] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:06:05 2022] DELETE /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments/57a18ba4-f747-48a6-8b4f-101a734fd94d => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:06:05.919873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7b57204b-2135-42bf-8784-6c4078977560 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:05.921058 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7b57204b-2135-42bf-8784-6c4078977560 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:05.928658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b57204b-2135-42bf-8784-6c4078977560 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:05.929101 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b57204b-2135-42bf-8784-6c4078977560 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:05.930569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b57204b-2135-42bf-8784-6c4078977560 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:05.931008 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7b57204b-2135-42bf-8784-6c4078977560 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:05.962820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7b57204b-2135-42bf-8784-6c4078977560 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047096 Jun 22 09:06:05.963400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 303/604] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:05 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:05.996808 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:05.997505 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:06.004924 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:06.005368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:06.006180 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:06.006641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:06.144618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:06.152464 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8c138af3-c50d-47ed-8d7a-d22524c9bdf0 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.159923 Jun 22 09:06:06.153156 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 302/605] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:05 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:06.793860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b28eefe2-32aa-4b7d-98b4-be548c80f462 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:06.794820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b28eefe2-32aa-4b7d-98b4-be548c80f462 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:06.807112 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b28eefe2-32aa-4b7d-98b4-be548c80f462 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:06.807583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b28eefe2-32aa-4b7d-98b4-be548c80f462 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:06.808347 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b28eefe2-32aa-4b7d-98b4-be548c80f462 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:06.808776 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b28eefe2-32aa-4b7d-98b4-be548c80f462 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:06.975300 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a6ad2aad-e957-41de-a26f-40d09f0ab7b2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:06.976279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a6ad2aad-e957-41de-a26f-40d09f0ab7b2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:06.983363 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6ad2aad-e957-41de-a26f-40d09f0ab7b2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:06.983803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6ad2aad-e957-41de-a26f-40d09f0ab7b2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:06.984682 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6ad2aad-e957-41de-a26f-40d09f0ab7b2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:06.985160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6ad2aad-e957-41de-a26f-40d09f0ab7b2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:07.016607 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a6ad2aad-e957-41de-a26f-40d09f0ab7b2 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Jun 22 09:06:07.017181 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 303/606] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:06 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:07.095889 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b28eefe2-32aa-4b7d-98b4-be548c80f462 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/action" status: 202 len: 0 microversion: 2.1 time: 0.305609 Jun 22 09:06:07.096598 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 304/607] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:06:06 2022] POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:06:07.105357 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:07.105972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:07.112814 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:07.113646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:07.114037 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:07.114894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:07.171080 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:07.172295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:07.178716 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:07.179571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:07.179942 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:07.180374 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:07.349396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:07.358942 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-510df462-e79e-4748-803a-62d157d8924d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1750 microversion: 2.1 time: 0.258164 Jun 22 09:06:07.360039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 304/608] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:07 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:07.421594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:07.430044 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0a4623a1-3312-4b20-b50b-200f46a5d955 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.263303 Jun 22 09:06:07.430647 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 305/609] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:07 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:08.029622 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-80a1ab2b-26a7-4282-ad52-5d80652aa0f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:08.030732 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-80a1ab2b-26a7-4282-ad52-5d80652aa0f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:08.037636 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80a1ab2b-26a7-4282-ad52-5d80652aa0f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:08.042857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80a1ab2b-26a7-4282-ad52-5d80652aa0f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:08.042857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80a1ab2b-26a7-4282-ad52-5d80652aa0f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:08.042857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-80a1ab2b-26a7-4282-ad52-5d80652aa0f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:08.072510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-80a1ab2b-26a7-4282-ad52-5d80652aa0f3 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Jun 22 09:06:08.073089 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 305/610] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:08 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:08.377311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:08.377876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:08.384443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:08.384882 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:08.385632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:08.386127 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:08.448465 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:08.449552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:08.456113 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:08.456637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:08.457495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:08.458008 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:08.619504 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:08.628109 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9d28d03b-a0d9-4275-a3bd-d16e7d030afb tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.254760 Jun 22 09:06:08.628992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 306/611] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:08 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:08.688244 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:08.695751 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-eefdcc62-befc-4121-8d5f-ecb3803a3b97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.251173 Jun 22 09:06:08.696318 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 306/612] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:08 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:09.084258 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fc075b3a-4b67-4404-b029-4e16fa601f7a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:09.085560 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fc075b3a-4b67-4404-b029-4e16fa601f7a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:09.091667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fc075b3a-4b67-4404-b029-4e16fa601f7a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:09.092113 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fc075b3a-4b67-4404-b029-4e16fa601f7a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:09.092877 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fc075b3a-4b67-4404-b029-4e16fa601f7a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:09.093307 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fc075b3a-4b67-4404-b029-4e16fa601f7a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:09.126519 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fc075b3a-4b67-4404-b029-4e16fa601f7a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Jun 22 09:06:09.127085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 307/613] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:09 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:09.651037 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:09.651649 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:09.658833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:09.659277 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:09.660050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:09.660482 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:09.713394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:09.713953 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:09.720811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:09.721263 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:09.722041 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:09.722508 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:09.743094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:09.869720 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:09.878029 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d93fb22f-fe34-4de3-9b37-555bec9cd985 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.230909 Jun 22 09:06:09.878624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 307/614] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:09 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:09.898485 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:09.905874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-99fd8642-d336-4704-bc52-bce0b77a6e6d tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.196599 Jun 22 09:06:09.906972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 308/615] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:09 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:10.138524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e20eea40-b502-4f6a-a7c6-a139a05c3271 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:10.139453 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e20eea40-b502-4f6a-a7c6-a139a05c3271 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:10.145874 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e20eea40-b502-4f6a-a7c6-a139a05c3271 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:10.146347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e20eea40-b502-4f6a-a7c6-a139a05c3271 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:10.150281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e20eea40-b502-4f6a-a7c6-a139a05c3271 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:10.150281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e20eea40-b502-4f6a-a7c6-a139a05c3271 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:10.176216 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e20eea40-b502-4f6a-a7c6-a139a05c3271 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041667 Jun 22 09:06:10.176758 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 308/616] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:10 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:10.894989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:10.895618 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:10.902080 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:10.902538 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:10.903324 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:10.903833 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:10.924465 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:10.925082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:10.932488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:10.932940 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:10.933729 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:10.934319 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.127023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:11.130673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:11.132388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:11.135179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-81b53059-e95a-4d08-aa20-888caa2a4b11 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.215427 Jun 22 09:06:11.135766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 309/617] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:10 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:11.142360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-aae62d72-621b-4f68-b9aa-96754e1d7154 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.251042 Jun 22 09:06:11.151797 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 309/618] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:10 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:11.152151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-40f7289e-9e09-4a98-b9ef-ef4b79a19682 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:11.152151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-40f7289e-9e09-4a98-b9ef-ef4b79a19682 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:11.157129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40f7289e-9e09-4a98-b9ef-ef4b79a19682 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.157596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40f7289e-9e09-4a98-b9ef-ef4b79a19682 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.158388 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40f7289e-9e09-4a98-b9ef-ef4b79a19682 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.158822 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40f7289e-9e09-4a98-b9ef-ef4b79a19682 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.188915 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3dc47f8f-aabe-4b93-9a9b-25d56f3c3f4e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:11.189913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-40f7289e-9e09-4a98-b9ef-ef4b79a19682 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments/17c5b930-2a9d-4c2a-a345-56daddf177af" status: 200 len: 194 microversion: 2.20 time: 0.043965 Jun 22 09:06:11.190099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3dc47f8f-aabe-4b93-9a9b-25d56f3c3f4e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:11.190469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 310/619] 10.222.0.36 () {60 vars in 1453 bytes} [Wed Jun 22 09:06:11 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments/17c5b930-2a9d-4c2a-a345-56daddf177af => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:06:11.195996 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dc47f8f-aabe-4b93-9a9b-25d56f3c3f4e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.196440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dc47f8f-aabe-4b93-9a9b-25d56f3c3f4e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.197219 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dc47f8f-aabe-4b93-9a9b-25d56f3c3f4e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.197647 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3dc47f8f-aabe-4b93-9a9b-25d56f3c3f4e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.228709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3dc47f8f-aabe-4b93-9a9b-25d56f3c3f4e tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Jun 22 09:06:11.229535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 310/620] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:11 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:06:11.255630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:11.256123 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:11.262716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.263163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.263963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.264424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.343782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lazy-loading 'services' on Instance uuid 570dea14-f80c-45cc-9935-7cf6d445d337 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:06:11.550868 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-859cb693-25d5-4da9-aae5-0dd6b4abbe67 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments/17c5b930-2a9d-4c2a-a345-56daddf177af" status: 202 len: 0 microversion: 2.20 time: 0.299319 Jun 22 09:06:11.551452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 311/621] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Jun 22 09:06:11 2022] DELETE /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments/17c5b930-2a9d-4c2a-a345-56daddf177af => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:06:11.559953 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6e26e61f-b689-4800-96f9-11c0f226e70c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:11.560984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6e26e61f-b689-4800-96f9-11c0f226e70c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:11.567859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6e26e61f-b689-4800-96f9-11c0f226e70c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.575772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6e26e61f-b689-4800-96f9-11c0f226e70c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.575772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6e26e61f-b689-4800-96f9-11c0f226e70c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:11.575772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6e26e61f-b689-4800-96f9-11c0f226e70c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:11.599922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6e26e61f-b689-4800-96f9-11c0f226e70c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Jun 22 09:06:11.600487 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 311/622] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 09:06:11 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 09:06:12.157286 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:12.157993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:12.163405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:12.164095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:12.164672 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.165130 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.165905 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.166366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.170873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.171318 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.172651 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.173275 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.385851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:12.393124 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:12.394601 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e6c6038a-1a3c-4ba1-8056-da1d80543d97 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.244750 Jun 22 09:06:12.395245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 312/623] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:12 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:12.400438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-109c5e4d-e305-42d3-9428-db913ac1fd3b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:12.401759 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-109c5e4d-e305-42d3-9428-db913ac1fd3b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:12.402780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1b93b5e5-08dd-49e7-b977-b735d273e24a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.243049 Jun 22 09:06:12.409170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-109c5e4d-e305-42d3-9428-db913ac1fd3b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.409666 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-109c5e4d-e305-42d3-9428-db913ac1fd3b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.410555 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-109c5e4d-e305-42d3-9428-db913ac1fd3b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.411043 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-109c5e4d-e305-42d3-9428-db913ac1fd3b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.413909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 312/624] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:12 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:12.443852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-109c5e4d-e305-42d3-9428-db913ac1fd3b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047280 Jun 22 09:06:12.444437 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 313/625] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:12 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:12.612249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-21f395df-8227-499f-910d-453913da911f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:12.613267 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-21f395df-8227-499f-910d-453913da911f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:12.620129 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21f395df-8227-499f-910d-453913da911f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.620568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21f395df-8227-499f-910d-453913da911f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.621481 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21f395df-8227-499f-910d-453913da911f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.621820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21f395df-8227-499f-910d-453913da911f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.653851 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-21f395df-8227-499f-910d-453913da911f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045715 Jun 22 09:06:12.654530 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 313/626] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 09:06:12 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:06:12.731677 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33784999-78f3-4c2b-99ed-2eb77620f07a"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:12.732790 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:12.739351 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.739796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.740603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.741043 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.829764 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Invalid volume: volume 33784999-78f3-4c2b-99ed-2eb77620f07a is already attached to instances: f943d146-cb3d-4f92-816a-536fc8e77c88 Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: POST /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments HTTP/1.1 Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 74 Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:06:12.831560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {"volumeAttachment": {"volumeId": "33784999-78f3-4c2b-99ed-2eb77620f07a"}} Jun 22 09:06:12.833557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Invalid volume: volume 33784999-78f3-4c2b-99ed-2eb77620f07a is already attached to instances: f943d146-cb3d-4f92-816a-536fc8e77c88 Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'server_id': 'f943d146-cb3d-4f92-816a-536fc8e77c88', 'body': {'volumeAttachment': {'volumeId': '33784999-78f3-4c2b-99ed-2eb77620f07a'}}} Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 33784999-78f3-4c2b-99ed-2eb77620f07a is already attached to instances: f943d146-cb3d-4f92-816a-536fc8e77c88 Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:12.834552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 33784999-78f3-4c2b-99ed-2eb77620f07a is already attached to instances: f943d146-cb3d-4f92-816a-536fc8e77c88 Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:12.835782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 33784999-78f3-4c2b-99ed-2eb77620f07a is already attached to instances: f943d146-cb3d-4f92-816a-536fc8e77c88 Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 400 to user: Invalid volume: volume 33784999-78f3-4c2b-99ed-2eb77620f07a is already attached to instances: f943d146-cb3d-4f92-816a-536fc8e77c88 {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a749faf1-a7bb-403c-a3bd-218b98d5db23 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105619 Jun 22 09:06:12.836959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 314/627] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:06:12 2022] POST /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:06:12.898554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:12.899044 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:12.905360 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.905864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:12.907159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:12.907610 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.042212 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lazy-loading 'services' on Instance uuid f943d146-cb3d-4f92-816a-536fc8e77c88 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:06:13.370900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d546a719-8382-4696-8d6a-9089fa045f3c tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments/33784999-78f3-4c2b-99ed-2eb77620f07a" status: 202 len: 0 microversion: 2.1 time: 0.426038 Jun 22 09:06:13.370900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 314/628] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:06:12 2022] DELETE /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments/33784999-78f3-4c2b-99ed-2eb77620f07a => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:06:13.371720 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0d83c320-82b1-4ba8-8b3d-fed43e0e790f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:13.371720 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0d83c320-82b1-4ba8-8b3d-fed43e0e790f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:13.371720 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0d83c320-82b1-4ba8-8b3d-fed43e0e790f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.371720 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0d83c320-82b1-4ba8-8b3d-fed43e0e790f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.372431 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0d83c320-82b1-4ba8-8b3d-fed43e0e790f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.372431 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0d83c320-82b1-4ba8-8b3d-fed43e0e790f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.372594 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0d83c320-82b1-4ba8-8b3d-fed43e0e790f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046714 Jun 22 09:06:13.373339 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 315/629] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:13 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:13.412808 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:13.413519 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:13.420027 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.420474 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.420584 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:13.421121 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:13.421231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.422176 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.428063 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.428516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.429282 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.429717 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.870469 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:13.878600 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bdce7326-0074-469d-bff8-ccc9f5bd9eaa tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1570 microversion: 2.1 time: 0.470005 Jun 22 09:06:13.879171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 315/630] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:13 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1570 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:13.894374 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9ab46872-e114-4e2a-88d8-a484ad57c5ea tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:13.895355 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9ab46872-e114-4e2a-88d8-a484ad57c5ea tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:13.895696 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:13.901452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9ab46872-e114-4e2a-88d8-a484ad57c5ea tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.901831 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9ab46872-e114-4e2a-88d8-a484ad57c5ea tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.902622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9ab46872-e114-4e2a-88d8-a484ad57c5ea tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.903053 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9ab46872-e114-4e2a-88d8-a484ad57c5ea tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.903613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-45519c6b-44fa-495e-9990-23e50df6485f tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.486891 Jun 22 09:06:13.904166 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 316/631] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:13 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:13.917411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bc5e18f7-86b4-4bfa-825d-c7be65250f83 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:13.922466 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bc5e18f7-86b4-4bfa-825d-c7be65250f83 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:13.925547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc5e18f7-86b4-4bfa-825d-c7be65250f83 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.926002 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc5e18f7-86b4-4bfa-825d-c7be65250f83 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.926833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc5e18f7-86b4-4bfa-825d-c7be65250f83 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.927330 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc5e18f7-86b4-4bfa-825d-c7be65250f83 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.933239 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9ab46872-e114-4e2a-88d8-a484ad57c5ea tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042746 Jun 22 09:06:13.933812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 316/632] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:13 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:13.939016 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4135d37e-cfd5-4b39-9f41-477bac0ac759 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:13.939572 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4135d37e-cfd5-4b39-9f41-477bac0ac759 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:13.945283 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4135d37e-cfd5-4b39-9f41-477bac0ac759 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.945738 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4135d37e-cfd5-4b39-9f41-477bac0ac759 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.946510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4135d37e-cfd5-4b39-9f41-477bac0ac759 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:13.946942 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4135d37e-cfd5-4b39-9f41-477bac0ac759 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:13.957869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-bc5e18f7-86b4-4bfa-825d-c7be65250f83 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050240 Jun 22 09:06:13.962910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 317/633] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 09:06:13 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:06:14.150363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4135d37e-cfd5-4b39-9f41-477bac0ac759 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "POST /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375/action" status: 202 len: 0 microversion: 2.1 time: 0.215446 Jun 22 09:06:14.150988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 317/634] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:06:13 2022] POST /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:06:14.159236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:14.159778 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:14.165899 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.166361 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.167127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.167562 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.307832 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:14.318558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d306cc38-e2b7-4ceb-967a-133e3a7fce53 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1518 microversion: 2.1 time: 0.163199 Jun 22 09:06:14.328826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 318/635] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:14 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:14.386183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-27366938-d0a5-4c39-95c3-a40e901dbf8d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:14.387105 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-27366938-d0a5-4c39-95c3-a40e901dbf8d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:14.394913 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27366938-d0a5-4c39-95c3-a40e901dbf8d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.395555 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27366938-d0a5-4c39-95c3-a40e901dbf8d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.396645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27366938-d0a5-4c39-95c3-a40e901dbf8d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.397129 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-27366938-d0a5-4c39-95c3-a40e901dbf8d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.428872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-27366938-d0a5-4c39-95c3-a40e901dbf8d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047581 Jun 22 09:06:14.429590 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 318/636] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:14 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:14.920767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:14.921285 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:14.928541 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.928996 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.929791 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.930252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.947712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-98b7ccc9-b12c-4253-a4c5-ecbdf3d973c6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:14.957828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-98b7ccc9-b12c-4253-a4c5-ecbdf3d973c6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:14.957828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-98b7ccc9-b12c-4253-a4c5-ecbdf3d973c6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.957828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-98b7ccc9-b12c-4253-a4c5-ecbdf3d973c6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.957828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-98b7ccc9-b12c-4253-a4c5-ecbdf3d973c6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:14.958486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-98b7ccc9-b12c-4253-a4c5-ecbdf3d973c6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:14.989033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-98b7ccc9-b12c-4253-a4c5-ecbdf3d973c6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045268 Jun 22 09:06:14.994199 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 319/637] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:14 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 09:06:14.994515 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0b18521e-9217-4a64-8e06-9fed4c7976de tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:14.995556 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0b18521e-9217-4a64-8e06-9fed4c7976de tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:15.002506 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0b18521e-9217-4a64-8e06-9fed4c7976de tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.003041 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0b18521e-9217-4a64-8e06-9fed4c7976de tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.003811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0b18521e-9217-4a64-8e06-9fed4c7976de tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.004250 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0b18521e-9217-4a64-8e06-9fed4c7976de tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.051302 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0b18521e-9217-4a64-8e06-9fed4c7976de tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060588 Jun 22 09:06:15.055441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 320/638] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 09:06:14 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:06:15.087358 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:15.087874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:15.097472 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.103399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.103399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.103399 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.103703 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:15.110476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-46005ce9-f1ae-4235-b6a7-a609af6bbf44 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.193574 Jun 22 09:06:15.111368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 319/639] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:14 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:15.131556 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:06:15.259620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:15.335991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:15.336607 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:15.342816 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.343257 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.344508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.344941 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.483874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e3b623a6-3c3d-43c8-a4b3-96cd0cab208f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 204 len: 0 microversion: 2.1 time: 0.407331 Jun 22 09:06:15.492235 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 321/640] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:06:15 2022] DELETE /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:06:15.495301 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e294190c-4ef8-4a02-b999-85785c63350e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:15.496316 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e294190c-4ef8-4a02-b999-85785c63350e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:15.504043 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e294190c-4ef8-4a02-b999-85785c63350e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.504503 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e294190c-4ef8-4a02-b999-85785c63350e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.505388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e294190c-4ef8-4a02-b999-85785c63350e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.505823 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e294190c-4ef8-4a02-b999-85785c63350e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.506211 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:15.513930 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-25c93654-07df-4875-88c9-b6a2ae58f9bd tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1518 microversion: 2.1 time: 0.181679 Jun 22 09:06:15.515047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 320/641] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:15 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:15.519994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:15.520887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:15.527698 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.528371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.529169 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:15.529600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:15.538001 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e294190c-4ef8-4a02-b999-85785c63350e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049704 Jun 22 09:06:15.538603 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 322/642] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:15 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:15.663760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:15.671358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-37963407-fcba-40b1-b3fb-9dac934f2394 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1689 microversion: 2.1 time: 0.154998 Jun 22 09:06:15.672729 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 321/643] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:15 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:16.029028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-a46494fe-e75e-4f4b-a6f1-f53968ff2809 req-6033652a-0aa1-436b-a5b7-7028652a2b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7dd4b24-61df-4868-a828-c99798580375", "name": "network-vif-unplugged", "status": "completed", "tag": "8322d52e-16ae-49fa-a614-eacc8025f50d"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:16.039514 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-a46494fe-e75e-4f4b-a6f1-f53968ff2809 req-6033652a-0aa1-436b-a5b7-7028652a2b42 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.041488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-a46494fe-e75e-4f4b-a6f1-f53968ff2809 req-6033652a-0aa1-436b-a5b7-7028652a2b42 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.051317 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.compute.server_external_events [req-a46494fe-e75e-4f4b-a6f1-f53968ff2809 req-6033652a-0aa1-436b-a5b7-7028652a2b42 service nova] Unable to find a host for instance c7dd4b24-61df-4868-a828-c99798580375. Dropping event network-vif-unplugged {{(pid=118028) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 09:06:16.052182 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-a46494fe-e75e-4f4b-a6f1-f53968ff2809 req-6033652a-0aa1-436b-a5b7-7028652a2b42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027046 Jun 22 09:06:16.052765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 323/644] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 09:06:16.063377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8703be00-1de0-4726-b1e7-65597f02a05c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:16.064348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8703be00-1de0-4726-b1e7-65597f02a05c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:16.070763 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8703be00-1de0-4726-b1e7-65597f02a05c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.071202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8703be00-1de0-4726-b1e7-65597f02a05c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.071948 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8703be00-1de0-4726-b1e7-65597f02a05c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.072493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8703be00-1de0-4726-b1e7-65597f02a05c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.101097 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8703be00-1de0-4726-b1e7-65597f02a05c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041759 Jun 22 09:06:16.101568 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 322/645] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 09:06:16 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:16.127963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:16.128729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:16.135342 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.135941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.136793 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.137401 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.170732 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:16.171153 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:16.177486 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.177938 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.178736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.179170 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.204706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:06:16.292338 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:16.301047 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-caf5ace6-1a42-4ee6-8b19-77ed00d5bbb1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.177096 Jun 22 09:06:16.301625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 324/646] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:16 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:16.465842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a437e287-47c2-4cfe-87b0-7be1675f1c4c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 204 len: 0 microversion: 2.20 time: 0.298717 Jun 22 09:06:16.466405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 323/647] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 09:06:16 2022] DELETE /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:06:16.475409 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:16.476010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:16.482864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.483312 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.484209 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.484900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.536869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:16.537573 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:16.543732 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.544280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.550119 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.550119 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.550330 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:16.659586 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:16.667752 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:16.669273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:16.670566 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-cb499567-7bc1-45fd-94f5-4357ad7255d3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.199005 Jun 22 09:06:16.671128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 325/648] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:16 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:16.676821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-55e59951-47f1-4494-812f-5c12f8938a25 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:16.677780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-55e59951-47f1-4494-812f-5c12f8938a25 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:16.683969 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-55e59951-47f1-4494-812f-5c12f8938a25 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.687910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-55e59951-47f1-4494-812f-5c12f8938a25 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.687910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-55e59951-47f1-4494-812f-5c12f8938a25 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.687910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-55e59951-47f1-4494-812f-5c12f8938a25 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.709523 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:16.717106 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-55e59951-47f1-4494-812f-5c12f8938a25 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Jun 22 09:06:16.717284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8a6d78f5-b8c8-4448-a624-8640cd9340da tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1520 microversion: 2.1 time: 0.184605 Jun 22 09:06:16.717612 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 326/649] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:16 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:16.718634 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 324/650] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:16 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:16.722460 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:16.723067 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:16.728869 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.729574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.730357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:16.730796 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:16.863934 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:16.871529 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-635501a9-19f4-4a9c-bd02-d70990774820 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1689 microversion: 2.1 time: 0.152910 Jun 22 09:06:16.872089 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 327/651] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:16 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:17.318916 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:17.319520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:17.325992 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.326488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.327235 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.327670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.468545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:17.477521 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9a0acdef-0e22-4ebb-9151-872085cd72e1 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.162633 Jun 22 09:06:17.478106 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 325/652] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:17 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:17.688830 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:17.689388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:17.695938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.696387 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.697142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.697574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.728484 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-48e9b684-1b2a-4244-8bef-5e10d9d79f1a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:17.729926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-48e9b684-1b2a-4244-8bef-5e10d9d79f1a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:17.736083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48e9b684-1b2a-4244-8bef-5e10d9d79f1a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.736529 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48e9b684-1b2a-4244-8bef-5e10d9d79f1a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.737293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48e9b684-1b2a-4244-8bef-5e10d9d79f1a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.737724 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48e9b684-1b2a-4244-8bef-5e10d9d79f1a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.767986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-48e9b684-1b2a-4244-8bef-5e10d9d79f1a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Jun 22 09:06:17.768572 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 326/653] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:17 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:06:17.773245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:17.773871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:17.779796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.780232 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.780982 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.781488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.838337 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:17.847648 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:17.849200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:17.850382 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-42b5b834-7a72-4977-9b70-57766e399361 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.165763 Jun 22 09:06:17.850946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 328/654] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:17 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:17.889309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:17.889948 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:17.897407 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.897855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.898658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:17.899094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:17.930684 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:17.939579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2e694f95-3421-483f-b4b1-a3ae80b41fd4 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1520 microversion: 2.1 time: 0.169304 Jun 22 09:06:17.940067 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 327/655] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:17 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:18.028893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:18.036907 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7869c48f-51b1-44c0-8c57-dfeb8fe71290 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1689 microversion: 2.1 time: 0.152061 Jun 22 09:06:18.037738 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 329/656] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:17 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:18.495553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:18.496160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:18.510963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.510963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.510963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.510963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.655813 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:18.663926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-61fd69f2-d842-4426-9c3c-e320a89c62ee tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.172184 Jun 22 09:06:18.664486 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 328/657] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:18 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:18.779937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-cbaedfcf-bad4-41a5-bd41-59368b300cde tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:18.780778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-cbaedfcf-bad4-41a5-bd41-59368b300cde tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:18.787747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cbaedfcf-bad4-41a5-bd41-59368b300cde tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.788201 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cbaedfcf-bad4-41a5-bd41-59368b300cde tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.788956 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cbaedfcf-bad4-41a5-bd41-59368b300cde tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.789389 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cbaedfcf-bad4-41a5-bd41-59368b300cde tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.817840 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-cbaedfcf-bad4-41a5-bd41-59368b300cde tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041982 Jun 22 09:06:18.818429 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 330/658] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:06:18 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:06:18.868688 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:18.869399 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:18.875637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.876268 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.876859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:18.877184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.877356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:18.877628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.883414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.883860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.884614 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:18.885045 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:18.910285 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:06:19.007297 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:19.015355 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:19.017073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:19.018342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-21bba4f9-5a60-4103-a5ae-bc2741baca06 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.153575 Jun 22 09:06:19.018900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 329/659] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:18 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:19.023226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:19.023858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:19.029710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.030261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.030950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.031384 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.164097 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:19.171585 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8e22e8c7-cdf9-426c-acc9-feb6ae8fdce1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1520 microversion: 2.1 time: 0.151715 Jun 22 09:06:19.172143 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 330/660] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:19 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:19.177168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:19.177764 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:19.183598 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.184038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.184784 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.185215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.191983 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-691acdeb-5b55-4a70-9dbd-76944317f831 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 204 len: 0 microversion: 2.1 time: 0.318620 Jun 22 09:06:19.192571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 331/661] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:06:18 2022] DELETE /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:06:19.200958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:19.201658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:19.209061 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.209511 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.210323 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.210763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.393530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:19.397542 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:19.401160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d6a841d8-5b49-45c9-bdf9-5ae89596047a tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1689 microversion: 2.1 time: 0.227882 Jun 22 09:06:19.401737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 331/662] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:19 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:19.405403 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4844d903-061c-4eb1-9746-735f2b52eef2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1679 microversion: 2.1 time: 0.208380 Jun 22 09:06:19.406095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 332/663] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:19 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:19.682000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:19.682565 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:19.689225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.689673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.690457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:19.690897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:19.834856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:19.842939 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e69054bf-06f0-4f31-ae97-f0e0e481e47e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.165053 Jun 22 09:06:19.843495 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 332/664] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:19 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:20.038085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:20.039809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:20.045798 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.046378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.047057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.047499 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.180194 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:20.188215 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:20.188842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:20.189566 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:20.189872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:20.191054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-aac4c4cd-8e79-4d3a-80ee-e578c8d37794 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.157220 Jun 22 09:06:20.191822 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 333/665] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:20 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:20.195798 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.196338 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.197112 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.197549 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.336911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:20.344655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ba052c0a-598f-4c9f-ada7-e18080571096 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1520 microversion: 2.1 time: 0.159816 Jun 22 09:06:20.345331 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 333/666] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:20 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:20.418889 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:20.419653 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:20.422634 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:20.423245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:20.425928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.426411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.427189 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.427617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.429741 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.430221 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.430976 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.431406 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.633872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:20.637810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:20.641886 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e0904c45-e4b7-4586-b104-2ec6d69ee02a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1679 microversion: 2.1 time: 0.222788 Jun 22 09:06:20.642482 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 334/667] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:20 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:20.645748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-26c16d3b-19c6-444f-a899-60073ffeaa97 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1689 microversion: 2.1 time: 0.230673 Jun 22 09:06:20.646411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 334/668] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:20 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:20.861533 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:20.862152 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:20.868567 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.869008 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:20.869752 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:20.870233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.013478 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:21.021416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b31a48ed-6b6d-4cb0-9a35-c1b1e3261918 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.164363 Jun 22 09:06:21.021979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 335/669] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:20 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:21.209051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:21.209595 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:21.216058 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.216493 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.217234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.217661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.362644 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:21.363252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:21.369848 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.370322 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.371116 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.371533 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.390485 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:21.401574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:21.403445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:21.404747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c1e69bc1-8cd1-4a5a-a804-17cfd933208b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.199693 Jun 22 09:06:21.405464 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 335/670] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:21 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:21.660921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:21.661537 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:21.668647 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.669094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.669990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.670476 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.752068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:21.760569 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2c3c0612-507b-4e5d-9cc8-56d9dd4ae68b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1520 microversion: 2.1 time: 0.401874 Jun 22 09:06:21.764243 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 336/671] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:21 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:21.768454 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:21.768843 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:21.775314 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.775867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:21.776942 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:21.777135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:22.260946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:22.268582 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-690032f4-8070-4aec-b53e-3be54f395607 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1679 microversion: 2.1 time: 0.613326 Jun 22 09:06:22.269150 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 336/672] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:21 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1679 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:22.273676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:22.274343 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:22.280068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:22.280508 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:22.281275 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:22.281703 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:22.288775 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:22.296417 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-04122a1e-c2c5-4c9f-a888-a82f7d6b2bdc tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1689 microversion: 2.1 time: 0.534281 Jun 22 09:06:22.296973 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 337/673] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:21 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1689 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:22.306428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:22.424966 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:22.425941 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:22.432353 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:22.433235 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:22.434250 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:22.434985 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:22.825639 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:22.835768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-03cda344-f09e-42cc-a0bb-b07d65fa582d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.565570 Jun 22 09:06:22.847831 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 337/674] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:22 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:22.852789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:22.853594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:22.855880 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:22.861019 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:22.861696 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:22.862508 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:22.862937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:23.225743 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:23.234717 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:23.236867 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:23.238032 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-be6ec28d-f728-4d41-96eb-301028723dc1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1722 microversion: 2.20 time: 0.818190 Jun 22 09:06:23.238609 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 338/675] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:22 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1722 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:23.286429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:23.287045 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:23.289873 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:23.294185 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:23.294630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:23.295386 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:23.295841 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:23.515763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:23.523436 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fbcc5184-e121-4073-808f-e1ccddaabf20 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1576 microversion: 2.1 time: 0.674425 Jun 22 09:06:23.524336 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 338/676] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:22 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1576 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:23.529576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:23.530207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:23.536762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:23.538013 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:23.538013 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:23.538417 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:23.668328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:23.677281 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-112acfc2-c354-4a1c-ae50-060c15dee5d1 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1621 microversion: 2.1 time: 0.152240 Jun 22 09:06:23.677885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 339/677] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:23 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1621 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:23.707455 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:23.715348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cf6e9670-da43-481b-9553-f805627814f3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1679 microversion: 2.1 time: 0.433466 Jun 22 09:06:23.715922 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 339/678] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:23 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1679 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:23.853118 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:23.853820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:23.860931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:23.861372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:23.862190 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:23.862616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.259028 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:24.259028 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:24.274465 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.274914 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.279749 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.280595 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.436142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:24.448077 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3701794e-33f6-459e-9ca1-e18186d751c3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1755 microversion: 2.1 time: 0.598704 Jun 22 09:06:24.458887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:24.463927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 340/679] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:23 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1755 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:24.464566 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:24.475816 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:24.480890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:24.492710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3f6afed9-adc0-4493-b754-bf3251787182 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1656 microversion: 2.20 time: 0.228995 Jun 22 09:06:24.493302 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 340/680] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:24 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1656 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:24.542253 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:24.544274 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:24.559570 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.561791 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.563414 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.565508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.603494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-f7eb3d55-d139-4bc6-81f3-4d793087ed00 req-27e364b9-67e4-4d69-8fb6-6eaad3c245dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0bc5af-2a76-4d82-a1c4-fba8eac05dba", "name": "network-vif-deleted", "tag": "9245704a-8d26-4a4c-af84-7c9cacbb258e"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:24.615631 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-f7eb3d55-d139-4bc6-81f3-4d793087ed00 req-27e364b9-67e4-4d69-8fb6-6eaad3c245dd service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.623205 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-f7eb3d55-d139-4bc6-81f3-4d793087ed00 req-27e364b9-67e4-4d69-8fb6-6eaad3c245dd service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.651296 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-f7eb3d55-d139-4bc6-81f3-4d793087ed00 req-27e364b9-67e4-4d69-8fb6-6eaad3c245dd service nova] Creating event network-vif-deleted:9245704a-8d26-4a4c-af84-7c9cacbb258e for instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba on hv-cinder-78729 Jun 22 09:06:24.671851 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-f7eb3d55-d139-4bc6-81f3-4d793087ed00 req-27e364b9-67e4-4d69-8fb6-6eaad3c245dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205096 Jun 22 09:06:24.671851 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 341/681] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:24.698731 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:24.699945 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:24.710999 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.712913 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.714287 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.714985 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.873938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:24.889719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-beb5cb45-fc48-4d82-a195-6e38c05e651b tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1621 microversion: 2.1 time: 0.196978 Jun 22 09:06:24.890565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 342/682] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:24 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1621 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:24.897086 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:24.902579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:24.915670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.916517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.918329 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:24.919288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:24.931721 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:24.952257 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0f943113-e71a-4a4c-ac19-e330f5da6695 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1576 microversion: 2.1 time: 0.404658 Jun 22 09:06:24.952257 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 341/683] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:24 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1576 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:25.016366 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:25.026886 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4df0b962-4ba2-4ca1-9c62-094464b4b5a2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1612 microversion: 2.1 time: 0.134879 Jun 22 09:06:25.027416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 343/684] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:24 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1612 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:25.466394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:25.467644 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:25.476710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.477241 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.478028 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.479488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.511806 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:25.513124 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:25.520564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.521023 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.521816 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.522288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.583180 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.583637 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.584103 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lazy-loading 'fault' on Instance uuid 570dea14-f80c-45cc-9935-7cf6d445d337 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:06:25.654954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:25.678788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:25.680490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:25.681698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-16cad3f3-dcee-44a3-989e-bfa51d493adf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 200 len: 1371 microversion: 2.20 time: 0.174065 Jun 22 09:06:25.682300 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 344/685] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:25 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:25.704530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:25.714504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3411f7a8-258a-4387-a977-998ad5924e66 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1758 microversion: 2.1 time: 0.251886 Jun 22 09:06:25.715759 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 342/686] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:25 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1758 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:25.908455 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:25.909425 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:25.920173 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.922271 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.923406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.929077 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.962005 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:25.962919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:25.978401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.979479 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:25.980710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:25.982330 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.023708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:26.024448 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.025099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lazy-loading 'fault' on Instance uuid 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:06:26.115290 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:26.125526 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1beef4cc-c5e7-41ac-b7f4-146e84c5d258 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 200 len: 1334 microversion: 2.1 time: 0.221716 Jun 22 09:06:26.137675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 345/687] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:25 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 1334 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:26.144916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:26.145940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:26.153682 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:26.154505 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.155932 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:26.156598 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.205212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:26.222994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-02990aa9-e5ea-4cab-b436-4d3c85e322d1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1576 microversion: 2.1 time: 0.263416 Jun 22 09:06:26.223657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 343/688] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:25 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:26.253705 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:26.254109 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.254553 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lazy-loading 'fault' on Instance uuid f943d146-cb3d-4f92-816a-536fc8e77c88 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:06:26.327936 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:26.336898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6c993e3e-cf8e-4f6e-8ae6-12d2dd186da2 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 200 len: 1331 microversion: 2.1 time: 0.197871 Jun 22 09:06:26.338187 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 346/689] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:26 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 1331 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:26.702705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-151ae3d3-4d13-4359-bc33-7a374c0aeea1 req-a6d1ff67-afaf-4224-a9b4-c0a50c3fd634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570dea14-f80c-45cc-9935-7cf6d445d337", "name": "network-vif-deleted", "tag": "be31663b-fa96-458a-8d8e-4d90d98f36db"}, {"server_uuid": "f943d146-cb3d-4f92-816a-536fc8e77c88", "name": "network-vif-deleted", "tag": "51a5ee08-b678-4117-ae2e-a4b0a95533aa"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:26.705451 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:26.706162 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:26.713093 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:26.713604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-151ae3d3-4d13-4359-bc33-7a374c0aeea1 req-a6d1ff67-afaf-4224-a9b4-c0a50c3fd634 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:26.713725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.714261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-151ae3d3-4d13-4359-bc33-7a374c0aeea1 req-a6d1ff67-afaf-4224-a9b4-c0a50c3fd634 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.714455 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:26.714941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:26.731429 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] HTTP exception thrown: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:06:26.731807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-151ae3d3-4d13-4359-bc33-7a374c0aeea1 req-a6d1ff67-afaf-4224-a9b4-c0a50c3fd634 service nova] Creating event network-vif-deleted:be31663b-fa96-458a-8d8e-4d90d98f36db for instance 570dea14-f80c-45cc-9935-7cf6d445d337 on hv-cinder-78729 Jun 22 09:06:26.732497 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-151ae3d3-4d13-4359-bc33-7a374c0aeea1 req-a6d1ff67-afaf-4224-a9b4-c0a50c3fd634 service nova] Creating event network-vif-deleted:51a5ee08-b678-4117-ae2e-a4b0a95533aa for instance f943d146-cb3d-4f92-816a-536fc8e77c88 on hv-cinder-78729 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Request method failure captured: Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 HTTP/1.1 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistqYYF0c54erDHMySiM1QET859niMVk4X_a-gGRrfxEw-TKllmfEP32Qy_oIVetbc-FYULaAiDhHIZG_zukfmr86s80fgqZ7cFu4sIoZ75cvfSUmwIvnYszAtPKzpmrMuItpL6sX4C-LerqlHOnfIK1Z-X8Clg7JP3VvnqU8fQnVdgM Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:06:26.733091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}] Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: dd07859f7aba4b908b2779af70a5f5e1 Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:06:26.734861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '570dea14-f80c-45cc-9935-7cf6d445d337'} Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:06:26.736134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:06:26.737527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:26.740075 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Returning 404 to user: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:06:26.740792 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-151ae3d3-4d13-4359-bc33-7a374c0aeea1 req-a6d1ff67-afaf-4224-a9b4-c0a50c3fd634 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041847 Jun 22 09:06:26.741279 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5581acf0-3cfb-4152-afd7-eeec8d4448eb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 404 len: 111 microversion: 2.20 time: 0.040245 Jun 22 09:06:26.741401 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 344/690] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:26.742341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 347/691] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:26 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:06:26.751783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a0ef43ab-47fa-4d73-892d-f1a8127c256c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '.version_select at 0x7fb33206ea60>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:26.836422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a0ef43ab-47fa-4d73-892d-f1a8127c256c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854460297" status: 204 len: 0 microversion: 2.20 time: 0.089163 Jun 22 09:06:26.837205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 345/692] 10.222.0.36 () {60 vars in 1261 bytes} [Wed Jun 22 09:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854460297 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:06:27.149932 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:27.151091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:27.157375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:27.157832 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:27.158637 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:27.159073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:27.172820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] HTTP exception thrown: Instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba could not be found. Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Request method failure captured: Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba HTTP/1.1 Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpESGTFaQxGtcndAFBrNLKBjja4-8WEHkQgrdwwJOcS3mOOgNl1Wt_XlYgfR-gAQ4esEgNy6I-lgmLbNqlEWaQ6B1raOj0LHh4L-H-ZidkFp5WY3reLNxIt9EqSqsyXh_ZJi0WijTJ5Ul7w36pmrdC32d1GaRA6UEsUFciKs_Ve0X4 Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:06:27.174408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}] Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: c5c6763ac1ea47da89d3bb29d630b48c Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba could not be found. Jun 22 09:06:27.175984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '3c0bc5af-2a76-4d82-a1c4-fba8eac05dba'} Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba could not be found. Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:06:27.176783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba could not be found. Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba could not be found. Jun 22 09:06:27.177916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.179033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Returning 404 to user: Instance 3c0bc5af-2a76-4d82-a1c4-fba8eac05dba could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:06:27.179033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ac30a5e6-0dc8-4da3-adbe-dd76f0ba2165 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba" status: 404 len: 111 microversion: 2.1 time: 0.029841 Jun 22 09:06:27.179033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 348/693] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:27 2022] GET /compute/v2.1/servers/3c0bc5af-2a76-4d82-a1c4-fba8eac05dba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:06:27.185012 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-660ed67f-372f-4b3c-b64f-0e22bc0d3e12 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '.version_select at 0x7fb331f02e50>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:27.240973 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:27.241572 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:27.247677 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:27.248134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:27.248891 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:27.249317 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:27.262086 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-660ed67f-372f-4b3c-b64f-0e22bc0d3e12 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841289564" status: 202 len: 0 microversion: 2.1 time: 0.080927 Jun 22 09:06:27.265567 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 346/694] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 09:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841289564 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:06:27.356624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:27.357879 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:27.367175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:27.367620 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:27.368571 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:27.369006 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:27.385878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 HTTP/1.1 Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:06:27.389127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:06:27.390777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'f943d146-cb3d-4f92-816a-536fc8e77c88'} Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:06:27.391733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:06:27.393451 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:27.394532 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:06:27.394532 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a8c4249a-0211-488f-8b79-81109838255d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 404 len: 111 microversion: 2.1 time: 0.039200 Jun 22 09:06:27.394532 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 347/695] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:27 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:06:27.402309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ad4ed5c2-ab0b-474c-a104-8b1f8f9209d4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '.version_select at 0x7fb331f739d0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:27.467405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:27.475132 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9d258f96-323d-4f61-8b35-eef6a4bb0053 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1576 microversion: 2.1 time: 0.238073 Jun 22 09:06:27.475692 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 349/696] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:27 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:27.489580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ad4ed5c2-ab0b-474c-a104-8b1f8f9209d4 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776918536" status: 202 len: 0 microversion: 2.1 time: 0.093314 Jun 22 09:06:27.490463 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 348/697] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 09:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776918536 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:06:27.772721 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-121298e7-eb1b-440e-9942-bc4556399db7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'create', calling method: .version_select at 0x7fb331e8bf70>, body: {"keypair": {"name": "tempest-keypair-277595967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpvjN2azRw/H+lv0Q37sqFbofsxD/QIMYcuoeHNBVEiBBgrwoqQu9AzrkCJaIKILfGjDkYQsWu5zchnGZgGuGQ6MRh7c62s7vfL486e8Iqmzu5RS1sosyxws2x/0pC0hw=="}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:27.787855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-121298e7-eb1b-440e-9942-bc4556399db7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for project ec813daa61ab4ac59a2197042fb35325. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:06:27.791707 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-121298e7-eb1b-440e-9942-bc4556399db7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for user dd07859f7aba4b908b2779af70a5f5e1 and project ec813daa61ab4ac59a2197042fb35325. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:06:27.885012 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-121298e7-eb1b-440e-9942-bc4556399db7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.116112 Jun 22 09:06:27.889510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 350/698] 10.222.0.36 () {62 vars in 1199 bytes} [Wed Jun 22 09:06:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 09:06:28.234212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-0c81a807-073d-4c83-9313-7ada714920d8 req-7997f673-7633-4b15-a878-c218db96b608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7dd4b24-61df-4868-a828-c99798580375", "name": "network-vif-plugged", "status": "completed", "tag": "8322d52e-16ae-49fa-a614-eacc8025f50d"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:28.243603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0c81a807-073d-4c83-9313-7ada714920d8 req-7997f673-7633-4b15-a878-c218db96b608 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:28.244077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0c81a807-073d-4c83-9313-7ada714920d8 req-7997f673-7633-4b15-a878-c218db96b608 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:28.254870 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-0c81a807-073d-4c83-9313-7ada714920d8 req-7997f673-7633-4b15-a878-c218db96b608 service nova] Creating event network-vif-plugged:8322d52e-16ae-49fa-a614-eacc8025f50d for instance c7dd4b24-61df-4868-a828-c99798580375 on hv-cinder-78729 Jun 22 09:06:28.259736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-0c81a807-073d-4c83-9313-7ada714920d8 req-7997f673-7633-4b15-a878-c218db96b608 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113552 Jun 22 09:06:28.260314 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 349/699] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:28.404428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-90a18cd8-8937-4d3e-a722-4e4eef6caa99 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: .version_select at 0x7fb331e1e8b0>, body: {"keypair": {"name": "tempest-keypair-768541412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMA1kuiBqm1FACC0Hk/Xu/oD4eqDGE4+qDTTSNVJUQ5ZoKHx9fO7j6AX2yOZnyz8hZL/FP8pC1+ZdF6dWusKXqwQ+epRPf9u6QiAcY7n0v9xA4I8RYMkIvlap7vlrTwLEQ=="}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:28.424294 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-90a18cd8-8937-4d3e-a722-4e4eef6caa99 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:06:28.428305 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-90a18cd8-8937-4d3e-a722-4e4eef6caa99 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:06:28.492974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:28.493806 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:28.500053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:28.500525 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:28.502245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:28.502688 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:28.534086 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-90a18cd8-8937-4d3e-a722-4e4eef6caa99 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133525 Jun 22 09:06:28.534893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 351/700] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:06:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:28.707588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:28.715210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d10102ff-af8e-4b7f-aad0-9a79313bcb1b tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1576 microversion: 2.1 time: 0.226496 Jun 22 09:06:28.715775 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 350/701] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:28 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:29.737984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:29.737984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:29.740943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:29.741389 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:29.742183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:29.742617 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:30.247478 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:30.255102 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-af5971b6-ba83-4649-8954-f4111bcb7947 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1576 microversion: 2.1 time: 0.526205 Jun 22 09:06:30.255658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 352/702] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:29 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1576 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:30.772748 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:30.773273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:30.779926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:30.780345 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:30.781126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:30.781562 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:30.811710 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-403609236", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15257489-695d-400e-ba82-cb5e772f9bd0"}], "security_groups": [{"name": "tempest-securitygroup--1828696530"}], "key_name": "tempest-keypair-277595967", "user_data": "}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:30.814267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:06:30.923527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] validate_networks() for [('15257489-695d-400e-ba82-cb5e772f9bd0', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:06:31.168104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1ec07f3c-dcaa-4c91-8af9-ac3f8a2a2fc4 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 204 len: 0 microversion: 2.1 time: 0.398942 Jun 22 09:06:31.168926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 351/703] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:06:30 2022] DELETE /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:06:31.179570 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:31.179570 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:31.184786 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:31.185230 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:31.185983 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:31.186592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:31.413908 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:31.421631 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a5e20ef6-cf6f-4a4c-b876-48e62b79a3b5 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1505 microversion: 2.1 time: 0.247788 Jun 22 09:06:31.422222 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 352/704] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:31 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:31.436807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:31.436807 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:31.437008 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:06:31.437008 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:06:31.437273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:06:31.437783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:06:31.438786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:06:31.442375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:31.442862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:31.443634 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:31.444073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:31.448178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:31.448624 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:31.449424 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:31.449858 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:31.467490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for project ec813daa61ab4ac59a2197042fb35325. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:06:31.472531 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Getting quotas for user dd07859f7aba4b908b2779af70a5f5e1 and project ec813daa61ab4ac59a2197042fb35325. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:06:31.485080 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:06:31.488242 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:06:31.579193 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:31.586722 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-398424eb-8d1a-41dd-9ec3-b5c4aa398de2 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1563 microversion: 2.1 time: 0.155554 Jun 22 09:06:31.592164 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 353/705] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:31 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:31.592280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1368003479", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89fc451c-46b3-4008-9c5d-bc37135b61a8"}], "security_groups": [{"name": "tempest-securitygroup--1306052844"}], "key_name": "tempest-keypair-768541412", "user_data": "}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:31.660789 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-976ce305-1c14-4ca4-83b8-163dcb1e390b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.853912 Jun 22 09:06:31.662152 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 353/706] 10.222.0.36 () {62 vars in 1187 bytes} [Wed Jun 22 09:06:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 09:06:31.671695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-68f7b4d5-fec6-4d1f-8627-315ee71acb3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:31.672279 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-68f7b4d5-fec6-4d1f-8627-315ee71acb3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:31.724283 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] validate_networks() for [('89fc451c-46b3-4008-9c5d-bc37135b61a8', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:06:31.738289 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-68f7b4d5-fec6-4d1f-8627-315ee71acb3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:31.748295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-68f7b4d5-fec6-4d1f-8627-315ee71acb3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:31.749788 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-68f7b4d5-fec6-4d1f-8627-315ee71acb3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:31.751514 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-68f7b4d5-fec6-4d1f-8627-315ee71acb3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1280 microversion: 2.20 time: 0.083224 Jun 22 09:06:31.763409 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 354/707] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:31 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:32.155684 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:06:32.156175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:06:32.156564 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:06:32.158104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:06:32.158553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:06:32.168115 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:32.175651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:32.175651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:32.175651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:32.188803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:06:32.193517 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Getting quotas for user cf981e5982644d708ddaba93a12b2b27 and project 3c906f2149774a18b39228b7b6ef556f. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:06:32.207510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:06:32.208123 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:06:32.328127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c057da31-f6e3-43ac-a0f2-61a92020ef1d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.739736 Jun 22 09:06:32.328869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 354/708] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:06:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:06:32.338953 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-51e918c0-0c88-45df-a0de-9af4dc017110 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:32.339562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-51e918c0-0c88-45df-a0de-9af4dc017110 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:32.396733 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-51e918c0-0c88-45df-a0de-9af4dc017110 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:32.403806 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-51e918c0-0c88-45df-a0de-9af4dc017110 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1241 microversion: 2.1 time: 0.068855 Jun 22 09:06:32.404687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 355/709] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:32 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:32.439500 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:32.440144 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:32.446655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:32.446995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:32.447737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:32.448205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:32.582093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:32.589599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-bc10ba6a-ff1e-4e93-94e9-1fec2ef49500 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1505 microversion: 2.1 time: 0.154143 Jun 22 09:06:32.590177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 355/710] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:32 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:32.771747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:32.772439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:32.778632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:32.779161 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:32.779990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:32.780567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:32.872379 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:32.883912 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:32.885716 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:32.887602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-683f0e74-3b49-4ef9-a33e-3aa850605384 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1284 microversion: 2.20 time: 0.119905 Jun 22 09:06:32.896974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 356/711] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:32 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:33.281275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-4aecb79b-0b06-4d52-b5cf-286e976dd65e req-eb936ea2-ab21-4985-b384-e84bbaf3e0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5de6423-e83b-4fcb-a9f2-2e9465c838dd", "name": "network-vif-deleted", "tag": "7d4f28bf-7d12-46f2-804e-2946377a0181"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:33.290645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-4aecb79b-0b06-4d52-b5cf-286e976dd65e req-eb936ea2-ab21-4985-b384-e84bbaf3e0ed service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:33.291178 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-4aecb79b-0b06-4d52-b5cf-286e976dd65e req-eb936ea2-ab21-4985-b384-e84bbaf3e0ed service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:33.302953 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-4aecb79b-0b06-4d52-b5cf-286e976dd65e req-eb936ea2-ab21-4985-b384-e84bbaf3e0ed service nova] Creating event network-vif-deleted:7d4f28bf-7d12-46f2-804e-2946377a0181 for instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd on hv-cinder-78729 Jun 22 09:06:33.308055 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-4aecb79b-0b06-4d52-b5cf-286e976dd65e req-eb936ea2-ab21-4985-b384-e84bbaf3e0ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030581 Jun 22 09:06:33.308656 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 356/712] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:33.421378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:33.422009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:33.429346 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:33.430030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:33.430838 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:33.431275 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:33.496263 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:33.504561 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1f881120-e2f2-4306-8a55-eec7fd0edd04 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1245 microversion: 2.1 time: 0.087263 Jun 22 09:06:33.505195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 357/713] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:33 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:33.608272 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:33.608985 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:33.622852 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:33.623303 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:33.624080 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:33.626680 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:33.730479 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:33.749560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-bd020047-84be-4b07-8ee1-d5794c3ae999 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 200 len: 1291 microversion: 2.1 time: 0.144843 Jun 22 09:06:33.750422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 357/714] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:33 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 1291 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:33.908063 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:33.908669 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:33.915118 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:33.915569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:33.916336 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:33.916769 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:33.986088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:33.994260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:33.995745 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:33.996833 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4308139f-458a-4531-95b7-77a399e5d3e6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1340 microversion: 2.20 time: 0.093853 Jun 22 09:06:33.997378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 358/715] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:33 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:34.522013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:34.523516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:34.542945 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:34.543350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:34.544129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:34.544561 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:34.626781 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:34.634816 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b0df5a67-58e7-4b57-8199-ebfa64b52230 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1293 microversion: 2.1 time: 0.116715 Jun 22 09:06:34.635400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 358/716] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:34 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1293 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:34.767520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:34.768660 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: d5de6423-e83b-4fcb-a9f2-2e9465c838dd] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:34.775351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:34.775803 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:34.776741 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:34.777185 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:34.795208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] HTTP exception thrown: Instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd could not be found. Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Request method failure captured: Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd HTTP/1.1 Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpESGTFaQxGtcndAFBrNLKBjja4-8WEHkQgrdwwJOcS3mOOgNl1Wt_XlYgfR-gAQ4esEgNy6I-lgmLbNqlEWaQ6B1raOj0LHh4L-H-ZidkFp5WY3reLNxIt9EqSqsyXh_ZJi0WijTJ5Ul7w36pmrdC32d1GaRA6UEsUFciKs_Ve0X4 Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:06:34.796763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}] Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: c5c6763ac1ea47da89d3bb29d630b48c Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd could not be found. Jun 22 09:06:34.799055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'd5de6423-e83b-4fcb-a9f2-2e9465c838dd'} Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd could not be found. Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:06:34.803416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd could not be found. Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd could not be found. Jun 22 09:06:34.805291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:06:34.807011 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Returning 404 to user: Instance d5de6423-e83b-4fcb-a9f2-2e9465c838dd could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:06:34.807011 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f33b89c9-6752-49ee-8455-f4f2f7374a74 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd" status: 404 len: 111 microversion: 2.1 time: 0.035574 Jun 22 09:06:34.807011 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 359/717] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:34 2022] GET /compute/v2.1/servers/d5de6423-e83b-4fcb-a9f2-2e9465c838dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:06:34.808537 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:34.809041 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:34.815897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:34.816612 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:34.817969 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:34.818764 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:34.868858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:06:35.015965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:35.017097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:35.023269 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:35.023706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:35.024464 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:35.024892 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:35.045318 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=100 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:35.209480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-56d996de-0a7e-4864-84b3-9da08a38a9ad tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 204 len: 0 microversion: 2.1 time: 0.404952 Jun 22 09:06:35.210147 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 359/718] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:06:34 2022] DELETE /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:06:35.218831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:35.220106 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:35.226581 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:35.227031 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:35.227806 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:35.228508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:35.248236 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:35.371619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:35.389371 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:35.394111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:35.395496 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f9dcc004-957f-42c3-a7c0-e762996deb69 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.383390 Jun 22 09:06:35.396252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 360/719] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:35 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:35.511729 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:35.521630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ed57b3d9-f1b5-4d7b-b26f-d9fdd5f816f9 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.306272 Jun 22 09:06:35.521630 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 360/720] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:35 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:35.656976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:35.657773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:35.665260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:35.665887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:35.666918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:35.667505 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:35.753612 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:35.762133 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-411709f0-938f-4bcb-a47f-3f6165cf846e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1299 microversion: 2.1 time: 0.109094 Jun 22 09:06:35.762957 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 361/721] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:35 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:35.981656 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-088befb9-b79a-41b9-9061-b72caf9d907b req-fe3f87f6-784c-41bb-81c8-053cbab04fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1ef288-3b6e-4369-8492-76898b858067", "tag": "f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:35.991138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-088befb9-b79a-41b9-9061-b72caf9d907b req-fe3f87f6-784c-41bb-81c8-053cbab04fd1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:35.991577 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-088befb9-b79a-41b9-9061-b72caf9d907b req-fe3f87f6-784c-41bb-81c8-053cbab04fd1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:36.004105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-088befb9-b79a-41b9-9061-b72caf9d907b req-fe3f87f6-784c-41bb-81c8-053cbab04fd1 service nova] Creating event network-changed:f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f for instance ea1ef288-3b6e-4369-8492-76898b858067 on hv-cinder-78729 Jun 22 09:06:36.009318 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-088befb9-b79a-41b9-9061-b72caf9d907b req-fe3f87f6-784c-41bb-81c8-053cbab04fd1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031540 Jun 22 09:06:36.009917 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 361/722] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:06:36.414674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:36.415246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:36.421785 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:36.422793 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:36.423527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:36.423960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:36.538042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:36.538829 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:36.545185 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:36.545627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:36.546553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:36.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:36.557801 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:36.566589 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:36.568092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:36.569270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-62fca84f-d75e-4314-a465-91461e0034c4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.158669 Jun 22 09:06:36.569785 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 362/723] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:36 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:36.678736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:36.686117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c45aa462-2d1b-4215-909f-a388f5ef9268 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.152890 Jun 22 09:06:36.686668 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 362/724] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:36 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:36.780193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:36.780811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:36.787468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:36.787909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:36.788669 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:36.789115 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:36.855698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:36.864145 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-40ab69b4-ae8e-4b3b-99e2-8e38c75849e9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1299 microversion: 2.1 time: 0.087769 Jun 22 09:06:36.864725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 363/725] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:36 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:37.587416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:37.588023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:37.595078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:37.595986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:37.597031 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:37.597474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:37.703125 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:37.704506 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:37.711245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:37.711763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:37.712597 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:37.713093 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:38.391609 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:38.400174 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:38.401673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:38.402813 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a961c784-3046-4962-b31b-d98288fcc763 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.819283 Jun 22 09:06:38.403573 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 363/726] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:37 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:38.408579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:38.409304 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:38.415713 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:38.416157 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:38.416921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:38.417350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:38.444251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:38.454916 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c85f4c81-7e9a-445b-8754-221e8012d76f tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1521 microversion: 2.1 time: 0.755396 Jun 22 09:06:38.464349 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 364/727] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:37 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1521 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:38.571132 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:38.579885 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4c2d4fb6-e2ed-4fc3-b7f4-894793e26927 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1299 microversion: 2.1 time: 0.174273 Jun 22 09:06:38.580326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 364/728] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:38 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:39.349264 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-572151d0-e3f7-40c4-b5f6-6214760564b2 req-eb35ee16-9d2b-4e67-bba7-6bf7a8adebe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4127e9-161c-4421-ab41-0115e64e2e02", "name": "network-vif-deleted", "tag": "63c4c500-8059-4142-83d0-d1cd70284258"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:39.356470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:39.365787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-572151d0-e3f7-40c4-b5f6-6214760564b2 req-eb35ee16-9d2b-4e67-bba7-6bf7a8adebe4 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:39.366272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-572151d0-e3f7-40c4-b5f6-6214760564b2 req-eb35ee16-9d2b-4e67-bba7-6bf7a8adebe4 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:39.380270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-572151d0-e3f7-40c4-b5f6-6214760564b2 req-eb35ee16-9d2b-4e67-bba7-6bf7a8adebe4 service nova] Creating event network-vif-deleted:63c4c500-8059-4142-83d0-d1cd70284258 for instance 8d4127e9-161c-4421-ab41-0115e64e2e02 on hv-cinder-78729 Jun 22 09:06:39.392308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-572151d0-e3f7-40c4-b5f6-6214760564b2 req-eb35ee16-9d2b-4e67-bba7-6bf7a8adebe4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041993 Jun 22 09:06:39.392308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 365/729] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:39.421225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:39.424104 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:39.428894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:39.429339 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:39.430120 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:39.430552 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:39.471992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:39.472684 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:39.479708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:39.480148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:39.480953 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:39.481380 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:39.600119 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:39.609542 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6240140e-b15b-44e1-ba98-1e528fea03a6 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1306 microversion: 2.1 time: 0.141662 Jun 22 09:06:39.610843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 366/730] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:39 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1306 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:06:39.615728 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:39.616786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:39.623019 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:39.623466 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:39.624245 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:39.625046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:39.811160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:39.819661 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:39.821214 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:39.822524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f9071e20-4b51-4470-b3e8-7c9327b6e6ef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.405279 Jun 22 09:06:39.823155 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 365/731] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:39 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:39.902849 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:39.911190 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1ebfbab3-2aa8-46bd-a574-ba3e4d84e000 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1367 microversion: 2.1 time: 0.299080 Jun 22 09:06:39.911855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 367/732] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:39 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:40.627937 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:40.628487 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:40.634831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:40.635271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:40.636020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:40.636459 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:40.667595 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:40.668035 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:40.668474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lazy-loading 'fault' on Instance uuid 8d4127e9-161c-4421-ab41-0115e64e2e02 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:06:40.709238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c6763ac1ea47da89d3bb29d630b48c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20fd7bac1c94a908fd293fa82c534dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:40.716715 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-349350a8-2c00-4640-93de-b8c407ea7221 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 200 len: 1311 microversion: 2.1 time: 0.093330 Jun 22 09:06:40.717268 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 366/733] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:40 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:41.047748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:41.047748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:41.047748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:41.047748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:41.048974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:41.048974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:41.049140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:41.049140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:41.049140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:41.049140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:41.049519 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:41.049519 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:41.155038 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:41.164776 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:41.166624 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:41.168037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b1cf3d24-0075-4c7c-be5f-b5b13efd9f04 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.331265 Jun 22 09:06:41.168646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 368/734] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:40 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:41.206204 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:41.214943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7ef5cb96-602d-48bc-adfe-5fc427296c11 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1367 microversion: 2.1 time: 0.290576 Jun 22 09:06:41.215523 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 367/735] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:40 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:41.403251 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-94445d19-a008-48f0-a5d8-7ec0ed4067ce req-67c3bda1-c437-4b29-9d58-7fb25afbf4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7518373c-b425-4a1c-b01b-32912b5257d5", "tag": "6638968f-6bd6-403a-a366-d6645776a688"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:41.411591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-94445d19-a008-48f0-a5d8-7ec0ed4067ce req-67c3bda1-c437-4b29-9d58-7fb25afbf4c0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:41.412031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-94445d19-a008-48f0-a5d8-7ec0ed4067ce req-67c3bda1-c437-4b29-9d58-7fb25afbf4c0 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:41.422602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-94445d19-a008-48f0-a5d8-7ec0ed4067ce req-67c3bda1-c437-4b29-9d58-7fb25afbf4c0 service nova] Creating event network-changed:6638968f-6bd6-403a-a366-d6645776a688 for instance 7518373c-b425-4a1c-b01b-32912b5257d5 on hv-cinder-78729 Jun 22 09:06:41.427365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-94445d19-a008-48f0-a5d8-7ec0ed4067ce req-67c3bda1-c437-4b29-9d58-7fb25afbf4c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027886 Jun 22 09:06:41.427938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 369/736] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:41.732986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:41.733626 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] [instance: 8d4127e9-161c-4421-ab41-0115e64e2e02] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:41.740803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:41.741245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:41.742007 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:41.742464 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:41.756235 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] HTTP exception thrown: Instance 8d4127e9-161c-4421-ab41-0115e64e2e02 could not be found. Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Request method failure captured: Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 HTTP/1.1 Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpESGTFaQxGtcndAFBrNLKBjja4-8WEHkQgrdwwJOcS3mOOgNl1Wt_XlYgfR-gAQ4esEgNy6I-lgmLbNqlEWaQ6B1raOj0LHh4L-H-ZidkFp5WY3reLNxIt9EqSqsyXh_ZJi0WijTJ5Ul7w36pmrdC32d1GaRA6UEsUFciKs_Ve0X4 Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:06:41.757956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d20fd7bac1c94a908fd293fa82c534dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d20fd7bac1c94a908fd293fa82c534dc"}]}] Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: d20fd7bac1c94a908fd293fa82c534dc Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1137559341 Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: c5c6763ac1ea47da89d3bb29d630b48c Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1137559341-project Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 8d4127e9-161c-4421-ab41-0115e64e2e02 could not be found. Jun 22 09:06:41.759637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '8d4127e9-161c-4421-ab41-0115e64e2e02'} Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4127e9-161c-4421-ab41-0115e64e2e02 could not be found. Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:06:41.760457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4127e9-161c-4421-ab41-0115e64e2e02 could not be found. Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4127e9-161c-4421-ab41-0115e64e2e02 could not be found. Jun 22 09:06:41.761913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:06:41.763270 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] Returning 404 to user: Instance 8d4127e9-161c-4421-ab41-0115e64e2e02 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:06:41.763270 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2a5f3e5e-51de-43fd-9161-43ddcc400452 tempest-ServerRescueNegativeTestJSON-1137559341 tempest-ServerRescueNegativeTestJSON-1137559341-project] 10.222.0.36 "GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02" status: 404 len: 111 microversion: 2.1 time: 0.030504 Jun 22 09:06:41.763270 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 368/737] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:41 2022] GET /compute/v2.1/servers/8d4127e9-161c-4421-ab41-0115e64e2e02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:06:42.184995 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:42.195686 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:42.197187 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:42.208350 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:42.209082 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:42.210230 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:42.211438 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:42.233210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:42.233927 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:42.244135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:42.245030 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=6 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:42.246617 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:42.247066 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:42.247846 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:42.248286 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:42.400964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=18 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:42.531045 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:42.531937 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:42.537798 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:42.541651 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:42.543538 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-58abb036-5735-43d0-93d1-21abdf3f3b37 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1367 microversion: 2.1 time: 0.314409 Jun 22 09:06:42.546601 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-77314f08-41c4-4498-b810-2f513446f5f3 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.363295 Jun 22 09:06:42.550498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 370/738] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:42 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:42.555556 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 369/739] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:42 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:43.563908 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:43.564587 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:43.572964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:43.573810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:43.574949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:43.575129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:43.575709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:43.576477 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:43.583510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:43.584224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:43.585191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:43.585790 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:43.790956 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:43.798754 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f4bb60be-6823-4098-835c-663f7c6d670d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1367 microversion: 2.1 time: 0.239116 Jun 22 09:06:43.803212 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 371/740] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:43 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:43.803482 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:43.815341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:43.816856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:43.818101 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a01ca7d6-65f2-463c-a7f9-92b446c396e5 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.247758 Jun 22 09:06:43.818832 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 370/741] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:43 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:44.418007 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-9ed80c3f-1ea3-41df-a36e-84659a9f930f req-e515e152-c99f-473b-9d36-44bc1837ec3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1ef288-3b6e-4369-8492-76898b858067", "name": "network-vif-plugged", "status": "completed", "tag": "f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:44.427219 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-9ed80c3f-1ea3-41df-a36e-84659a9f930f req-e515e152-c99f-473b-9d36-44bc1837ec3c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:44.427663 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-9ed80c3f-1ea3-41df-a36e-84659a9f930f req-e515e152-c99f-473b-9d36-44bc1837ec3c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:44.440737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-9ed80c3f-1ea3-41df-a36e-84659a9f930f req-e515e152-c99f-473b-9d36-44bc1837ec3c service nova] Creating event network-vif-plugged:f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f for instance ea1ef288-3b6e-4369-8492-76898b858067 on hv-cinder-78729 Jun 22 09:06:44.451967 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-9ed80c3f-1ea3-41df-a36e-84659a9f930f req-e515e152-c99f-473b-9d36-44bc1837ec3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036780 Jun 22 09:06:44.453308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 372/742] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:44.816462 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:44.817870 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:44.838186 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:44.839500 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:44.848082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:44.851659 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:44.852029 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:44.852299 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:44.852754 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:44.852870 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:44.853207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:44.853578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:44.854303 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:45.137347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:45.140128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:45.147909 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a6232d1e-0e68-4bf5-80f4-40b6b266223b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1367 microversion: 2.1 time: 0.336110 Jun 22 09:06:45.150962 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:45.153109 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:45.154471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4593d043-260f-4ac1-8814-aca630d42fb6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.321869 Jun 22 09:06:45.159260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 373/743] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:44 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:45.159457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 371/744] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:44 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:46.164762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:46.165377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:46.172820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:46.173574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:46.174222 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:46.174689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:46.174825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:46.175184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:46.183090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:46.183527 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:46.184430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:46.184868 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:46.445783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:46.453466 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ff6e11e9-3903-4877-aed7-6469a1244630 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1367 microversion: 2.1 time: 0.292552 Jun 22 09:06:46.454040 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 374/745] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:46 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:46.460271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:46.470024 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:46.475993 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-a26817bf-312f-4792-becf-f27660cfc61b req-dcd33929-0535-430a-a95d-a4e39161e799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7518373c-b425-4a1c-b01b-32912b5257d5", "name": "network-vif-plugged", "status": "completed", "tag": "6638968f-6bd6-403a-a366-d6645776a688"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:46.480438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:46.481593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-48923462-da7f-49d7-b5db-1029b815d02a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1406 microversion: 2.20 time: 0.312049 Jun 22 09:06:46.482184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 372/746] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:46 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:06:46.492954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-a26817bf-312f-4792-becf-f27660cfc61b req-dcd33929-0535-430a-a95d-a4e39161e799 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:46.494083 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-a26817bf-312f-4792-becf-f27660cfc61b req-dcd33929-0535-430a-a95d-a4e39161e799 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:46.505771 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-a26817bf-312f-4792-becf-f27660cfc61b req-dcd33929-0535-430a-a95d-a4e39161e799 service nova] Creating event network-vif-plugged:6638968f-6bd6-403a-a366-d6645776a688 for instance 7518373c-b425-4a1c-b01b-32912b5257d5 on hv-cinder-78729 Jun 22 09:06:46.511445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-a26817bf-312f-4792-becf-f27660cfc61b req-dcd33929-0535-430a-a95d-a4e39161e799 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038572 Jun 22 09:06:46.512029 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 375/747] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:47.469302 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:47.470044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:47.476472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:47.476917 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:47.477699 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:47.478157 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:47.501653 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:47.502367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:47.509160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:47.509604 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:47.510393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:47.510822 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:47.667774 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:47.693215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3890b81b-e7e0-46a0-adf6-995f62ff8de9 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1367 microversion: 2.1 time: 0.212608 Jun 22 09:06:47.693215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 373/748] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:47 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:47.696391 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:47.704700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:47.706234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:47.707505 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-45ea9c70-f2b4-4ed3-ad43-78752b598117 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1598 microversion: 2.20 time: 0.210683 Jun 22 09:06:47.708063 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 376/749] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:06:47 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1598 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:06:47.725347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-610fc217-6b61-4ac0-b620-8dfe4c277e7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:47.725927 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-610fc217-6b61-4ac0-b620-8dfe4c277e7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:47.732153 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-610fc217-6b61-4ac0-b620-8dfe4c277e7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:47.732673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-610fc217-6b61-4ac0-b620-8dfe4c277e7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:47.733566 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-610fc217-6b61-4ac0-b620-8dfe4c277e7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:47.734158 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-610fc217-6b61-4ac0-b620-8dfe4c277e7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:47.812109 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-610fc217-6b61-4ac0-b620-8dfe4c277e7c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090687 Jun 22 09:06:47.813416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 374/750] 10.222.0.36 () {60 vars in 1315 bytes} [Wed Jun 22 09:06:47 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:06:48.700644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:48.701256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:48.709816 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:48.712449 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:48.712449 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:48.712449 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:48.936813 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-10e4a83c-e693-4456-bbeb-9d2fb0881b78 req-ec2a28d8-aa41-40e3-abe1-589e6a8d4a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1ef288-3b6e-4369-8492-76898b858067", "tag": "f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:48.937655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:06:48.945880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-10e4a83c-e693-4456-bbeb-9d2fb0881b78 req-ec2a28d8-aa41-40e3-abe1-589e6a8d4a55 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:48.946353 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-10e4a83c-e693-4456-bbeb-9d2fb0881b78 req-ec2a28d8-aa41-40e3-abe1-589e6a8d4a55 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:48.946548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-78c51f98-a602-4576-896d-27afb9d013ef tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1555 microversion: 2.1 time: 0.249568 Jun 22 09:06:48.947325 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 377/751] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:06:48 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:06:48.964664 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-10e4a83c-e693-4456-bbeb-9d2fb0881b78 req-ec2a28d8-aa41-40e3-abe1-589e6a8d4a55 service nova] Creating event network-changed:f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f for instance ea1ef288-3b6e-4369-8492-76898b858067 on hv-cinder-78729 Jun 22 09:06:48.971679 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d97f4232-dc82-4e77-ba03-e56ecc17922e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:06:48.972516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d97f4232-dc82-4e77-ba03-e56ecc17922e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:06:48.973631 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-10e4a83c-e693-4456-bbeb-9d2fb0881b78 req-ec2a28d8-aa41-40e3-abe1-589e6a8d4a55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040151 Jun 22 09:06:48.974753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 375/752] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:06:48.980805 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d97f4232-dc82-4e77-ba03-e56ecc17922e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:48.981470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d97f4232-dc82-4e77-ba03-e56ecc17922e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:48.983521 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d97f4232-dc82-4e77-ba03-e56ecc17922e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:48.983521 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d97f4232-dc82-4e77-ba03-e56ecc17922e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:49.109025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d97f4232-dc82-4e77-ba03-e56ecc17922e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142373 Jun 22 09:06:49.114293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 378/753] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:06:48 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:06:50.433996 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-0de9274c-8b2f-4050-a5a5-d1956f747e18 req-6d686874-a632-4c6d-867b-4d849d15577d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7518373c-b425-4a1c-b01b-32912b5257d5", "tag": "6638968f-6bd6-403a-a366-d6645776a688"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:06:50.443785 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0de9274c-8b2f-4050-a5a5-d1956f747e18 req-6d686874-a632-4c6d-867b-4d849d15577d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:06:50.444319 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0de9274c-8b2f-4050-a5a5-d1956f747e18 req-6d686874-a632-4c6d-867b-4d849d15577d service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:06:50.455863 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-0de9274c-8b2f-4050-a5a5-d1956f747e18 req-6d686874-a632-4c6d-867b-4d849d15577d service nova] Creating event network-changed:6638968f-6bd6-403a-a366-d6645776a688 for instance 7518373c-b425-4a1c-b01b-32912b5257d5 on hv-cinder-78729 Jun 22 09:06:50.462610 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-0de9274c-8b2f-4050-a5a5-d1956f747e18 req-6d686874-a632-4c6d-867b-4d849d15577d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178242 Jun 22 09:06:50.463296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 376/754] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:05.967898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=27 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:05.968654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=92 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:05.973120 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-916218320"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:05.973656 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:05.979796 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:05.980276 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:05.981028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:05.981464 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:06.114180 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.network.security_group_api [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Removing security group e4383816-2a1c-4c39-8d72-93c86f94c5cb from port 999fae5e-5944-444b-a551-890daaa2af68 Jun 22 09:07:06.511837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d847defa-62da-4582-88c3-ab1fde03676d tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/action" status: 202 len: 0 microversion: 2.1 time: 0.545290 Jun 22 09:07:06.519500 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 379/755] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:07:05 2022] POST /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:07:06.538362 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-2b184693-3ab1-4308-8bb2-66e34a303127 req-c848d236-0069-4c67-a278-390dc663cb84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af5fd5f-bacb-4b11-87e5-775523e12208", "tag": "999fae5e-5944-444b-a551-890daaa2af68"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:06.555634 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=11 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:06.559129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=82 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:06.570718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-2b184693-3ab1-4308-8bb2-66e34a303127 req-c848d236-0069-4c67-a278-390dc663cb84 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:06.573711 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-2b184693-3ab1-4308-8bb2-66e34a303127 req-c848d236-0069-4c67-a278-390dc663cb84 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:06.599181 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-2b184693-3ab1-4308-8bb2-66e34a303127 req-c848d236-0069-4c67-a278-390dc663cb84 service nova] Creating event network-changed:999fae5e-5944-444b-a551-890daaa2af68 for instance 6af5fd5f-bacb-4b11-87e5-775523e12208 on hv-cinder-78729 Jun 22 09:07:06.614416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-2b184693-3ab1-4308-8bb2-66e34a303127 req-c848d236-0069-4c67-a278-390dc663cb84 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091651 Jun 22 09:07:06.615878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 377/756] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:08.065198 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:08.066447 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:08.072894 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:08.073338 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:08.074116 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:08.074548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:08.160514 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lazy-loading 'services' on Instance uuid 6af5fd5f-bacb-4b11-87e5-775523e12208 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:07:08.400157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-803f6323-fb0d-49b4-bccb-6bf6ffce9c06 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments/7e4f2aeb-e326-4375-9bae-5c7490e99c75" status: 202 len: 0 microversion: 2.1 time: 0.339310 Jun 22 09:07:08.400757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 380/757] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:07:08 2022] DELETE /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments/7e4f2aeb-e326-4375-9bae-5c7490e99c75 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:07:08.410997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cb9802e2-8e29-4945-90cd-cdfb16619eb7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:08.412405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cb9802e2-8e29-4945-90cd-cdfb16619eb7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:08.419568 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cb9802e2-8e29-4945-90cd-cdfb16619eb7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:08.420023 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cb9802e2-8e29-4945-90cd-cdfb16619eb7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:08.420837 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cb9802e2-8e29-4945-90cd-cdfb16619eb7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:08.421261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cb9802e2-8e29-4945-90cd-cdfb16619eb7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:08.453179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cb9802e2-8e29-4945-90cd-cdfb16619eb7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047700 Jun 22 09:07:08.453743 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 378/758] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:08 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:08.638860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-cec6a133-e09e-4fff-9269-9b987d23ad6d req-e21c55b2-5fdd-4b03-a220-8250247bf5df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af5fd5f-bacb-4b11-87e5-775523e12208", "tag": "999fae5e-5944-444b-a551-890daaa2af68"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:08.649914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-cec6a133-e09e-4fff-9269-9b987d23ad6d req-e21c55b2-5fdd-4b03-a220-8250247bf5df service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:08.650384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-cec6a133-e09e-4fff-9269-9b987d23ad6d req-e21c55b2-5fdd-4b03-a220-8250247bf5df service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:08.662095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-cec6a133-e09e-4fff-9269-9b987d23ad6d req-e21c55b2-5fdd-4b03-a220-8250247bf5df service nova] Creating event network-changed:999fae5e-5944-444b-a551-890daaa2af68 for instance 6af5fd5f-bacb-4b11-87e5-775523e12208 on hv-cinder-78729 Jun 22 09:07:08.667237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-cec6a133-e09e-4fff-9269-9b987d23ad6d req-e21c55b2-5fdd-4b03-a220-8250247bf5df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037545 Jun 22 09:07:08.667840 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 381/759] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:09.465109 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-87a1bb68-70ef-4a0e-a578-37f3668001c2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:09.466085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-87a1bb68-70ef-4a0e-a578-37f3668001c2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:09.473383 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87a1bb68-70ef-4a0e-a578-37f3668001c2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:09.473835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87a1bb68-70ef-4a0e-a578-37f3668001c2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:09.474624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87a1bb68-70ef-4a0e-a578-37f3668001c2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:09.475184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-87a1bb68-70ef-4a0e-a578-37f3668001c2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:09.506760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-87a1bb68-70ef-4a0e-a578-37f3668001c2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Jun 22 09:07:09.507379 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 379/760] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:09 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:10.518405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1771c80a-0967-41fb-b3c6-efd422432327 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:10.519601 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1771c80a-0967-41fb-b3c6-efd422432327 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:10.525841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1771c80a-0967-41fb-b3c6-efd422432327 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:10.526310 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1771c80a-0967-41fb-b3c6-efd422432327 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:10.527056 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1771c80a-0967-41fb-b3c6-efd422432327 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:10.527482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1771c80a-0967-41fb-b3c6-efd422432327 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:10.556136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1771c80a-0967-41fb-b3c6-efd422432327 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042447 Jun 22 09:07:10.556685 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 382/761] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:10 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:07:10.567865 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:10.568354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:10.575009 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:10.575459 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:10.585354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:10.585354 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:10.652579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] HTTP exception thrown: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 is not attached to volume 7e4f2aeb-e326-4375-9bae-5c7490e99c75 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Request method failure captured: Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: DELETE /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments/7e4f2aeb-e326-4375-9bae-5c7490e99c75 HTTP/1.1 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistsSC4ngvJsFQilfcaDcTByHq31bikqNA_TgAkT3rDvY4rzGJfjsTWbX4qYBtecJFA_hhDOgQDP82lLOAd4Rr4w485OZOYlzZLuPkZrVRzfFkssssDd4hltZSqPHyQF5YhdoGZJgM78VvanfEbbnhNAw9IeMeArZXiDY8qay8U9xWL0 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 85bf3e1b89094cafa7d469ed3f84eb36 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-TestMinimumBasicScenario-276205112 Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:07:10.655053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85bf3e1b89094cafa7d469ed3f84eb36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85bf3e1b89094cafa7d469ed3f84eb36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85bf3e1b89094cafa7d469ed3f84eb36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85bf3e1b89094cafa7d469ed3f84eb36"}]}] Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-TestMinimumBasicScenario-276205112 Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 85bf3e1b89094cafa7d469ed3f84eb36 Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-TestMinimumBasicScenario-276205112 Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-TestMinimumBasicScenario-276205112-project Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 448ee30440fb46779216649dd6907331 Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-TestMinimumBasicScenario-276205112-project Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:07:10.656616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 is not attached to volume 7e4f2aeb-e326-4375-9bae-5c7490e99c75 Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'server_id': '6af5fd5f-bacb-4b11-87e5-775523e12208', 'id': '7e4f2aeb-e326-4375-9bae-5c7490e99c75'} Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7e4f2aeb-e326-4375-9bae-5c7490e99c75. Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:10.657449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 is not attached to volume 7e4f2aeb-e326-4375-9bae-5c7490e99c75 Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 is not attached to volume 7e4f2aeb-e326-4375-9bae-5c7490e99c75 Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:10.658686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Returning 404 to user: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 is not attached to volume 7e4f2aeb-e326-4375-9bae-5c7490e99c75 {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:10.659621 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1fc687ca-e3d1-41c2-805f-dbc7e0b3fc69 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments/7e4f2aeb-e326-4375-9bae-5c7490e99c75" status: 404 len: 154 microversion: 2.1 time: 0.093601 Jun 22 09:07:10.659621 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 380/762] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:07:10 2022] DELETE /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208/os-volume_attachments/7e4f2aeb-e326-4375-9bae-5c7490e99c75 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:11.962047 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:11.962576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:11.969153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:11.969599 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:11.970375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:11.970813 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:11.995841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:07:12.280468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1f282c2a-04bc-430c-8bc9-922e9d90118e tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 204 len: 0 microversion: 2.1 time: 0.321905 Jun 22 09:07:12.281091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 383/763] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:07:11 2022] DELETE /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:07:12.290264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:12.290870 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:12.297205 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:12.297644 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:12.302220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:12.302220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:12.436013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:12.443718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b2745623-9eeb-4c8c-a5d1-dbae30f20bf3 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1554 microversion: 2.1 time: 0.157453 Jun 22 09:07:12.444268 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 381/764] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:12 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:13.463318 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:13.464118 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:13.470993 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:13.471514 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:13.473091 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:13.473639 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:13.610848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:13.618605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d3b0cb36-7a4f-4db4-a799-4f0412335eb2 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1554 microversion: 2.1 time: 0.160637 Jun 22 09:07:13.619170 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 384/765] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:13 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:14.646442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:14.647038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:14.653458 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:14.653989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:14.654886 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:14.655324 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:14.862337 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-6f70b141-b479-49e0-af1a-0bd8c8935968 req-9a003918-33bd-4465-9e26-c6bb2cf7a637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af5fd5f-bacb-4b11-87e5-775523e12208", "name": "network-vif-deleted", "tag": "999fae5e-5944-444b-a551-890daaa2af68"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:14.872815 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-6f70b141-b479-49e0-af1a-0bd8c8935968 req-9a003918-33bd-4465-9e26-c6bb2cf7a637 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:14.873291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-6f70b141-b479-49e0-af1a-0bd8c8935968 req-9a003918-33bd-4465-9e26-c6bb2cf7a637 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:14.879247 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448ee30440fb46779216649dd6907331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf3e1b89094cafa7d469ed3f84eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:14.885364 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-6f70b141-b479-49e0-af1a-0bd8c8935968 req-9a003918-33bd-4465-9e26-c6bb2cf7a637 service nova] Creating event network-vif-deleted:999fae5e-5944-444b-a551-890daaa2af68 for instance 6af5fd5f-bacb-4b11-87e5-775523e12208 on hv-cinder-78729 Jun 22 09:07:14.888760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0a49e45a-b6c8-41e0-a72a-741ecef79f02 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 200 len: 1554 microversion: 2.1 time: 0.245240 Jun 22 09:07:14.888760 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 382/766] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:14 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 1554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:14.891928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-6f70b141-b479-49e0-af1a-0bd8c8935968 req-9a003918-33bd-4465-9e26-c6bb2cf7a637 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034955 Jun 22 09:07:14.892521 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 385/767] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:15.904846 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:15.905464 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] [instance: 6af5fd5f-bacb-4b11-87e5-775523e12208] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:15.912397 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:15.912816 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:15.913593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:15.914030 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:15.928143 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] HTTP exception thrown: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 could not be found. Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Request method failure captured: Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 HTTP/1.1 Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistsSC4ngvJsFQilfcaDcTByHq31bikqNA_TgAkT3rDvY4rzGJfjsTWbX4qYBtecJFA_hhDOgQDP82lLOAd4Rr4w485OZOYlzZLuPkZrVRzfFkssssDd4hltZSqPHyQF5YhdoGZJgM78VvanfEbbnhNAw9IeMeArZXiDY8qay8U9xWL0 Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 85bf3e1b89094cafa7d469ed3f84eb36 Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-TestMinimumBasicScenario-276205112 Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:07:15.931862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85bf3e1b89094cafa7d469ed3f84eb36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85bf3e1b89094cafa7d469ed3f84eb36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85bf3e1b89094cafa7d469ed3f84eb36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85bf3e1b89094cafa7d469ed3f84eb36"}]}] Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-TestMinimumBasicScenario-276205112 Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 85bf3e1b89094cafa7d469ed3f84eb36 Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-TestMinimumBasicScenario-276205112 Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-TestMinimumBasicScenario-276205112-project Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 448ee30440fb46779216649dd6907331 Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-TestMinimumBasicScenario-276205112-project Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 could not be found. Jun 22 09:07:15.933400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '6af5fd5f-bacb-4b11-87e5-775523e12208'} Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 could not be found. Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:15.934341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 could not be found. Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 could not be found. Jun 22 09:07:15.935834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:15.937148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Returning 404 to user: Instance 6af5fd5f-bacb-4b11-87e5-775523e12208 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:15.937148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3352c677-7aa9-4bb8-9118-821aa24a32a7 tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208" status: 404 len: 111 microversion: 2.1 time: 0.030287 Jun 22 09:07:15.937148 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 383/768] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:15 2022] GET /compute/v2.1/servers/6af5fd5f-bacb-4b11-87e5-775523e12208 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:15.942186 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bb128e3c-394b-4184-aace-836f9419cf2a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] Calling method '.version_select at 0x7fb331ef5670>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:16.067611 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bb128e3c-394b-4184-aace-836f9419cf2a tempest-TestMinimumBasicScenario-276205112 tempest-TestMinimumBasicScenario-276205112-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-289684474" status: 202 len: 0 microversion: 2.1 time: 0.130780 Jun 22 09:07:16.071719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 386/769] 10.222.0.36 () {58 vars in 1268 bytes} [Wed Jun 22 09:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-289684474 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:07:26.437012 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-81131bf0-15e4-4920-9dd2-9f4bac8f3a47 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:26.437522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-81131bf0-15e4-4920-9dd2-9f4bac8f3a47 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:26.441293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=14 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:26.441984 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=34 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:26.448225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81131bf0-15e4-4920-9dd2-9f4bac8f3a47 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:26.448849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81131bf0-15e4-4920-9dd2-9f4bac8f3a47 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:26.449826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81131bf0-15e4-4920-9dd2-9f4bac8f3a47 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:26.450313 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-81131bf0-15e4-4920-9dd2-9f4bac8f3a47 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:26.480000 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-81131bf0-15e4-4920-9dd2-9f4bac8f3a47 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/ips" status: 200 len: 147 microversion: 2.1 time: 0.048101 Jun 22 09:07:26.480280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 384/770] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:07:26 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/ips => generated 147 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:28.132055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-7dcde31e-ab95-46d0-a326-a5c48060131a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b1d121e-0132-45cc-a824-d21439858b0f"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:28.133225 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-7dcde31e-ab95-46d0-a326-a5c48060131a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:28.135738 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:28.136386 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:28.143528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7dcde31e-ab95-46d0-a326-a5c48060131a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:28.149674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7dcde31e-ab95-46d0-a326-a5c48060131a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:28.149674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7dcde31e-ab95-46d0-a326-a5c48060131a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:28.149674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-7dcde31e-ab95-46d0-a326-a5c48060131a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:28.853184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-7dcde31e-ab95-46d0-a326-a5c48060131a tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "POST /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.725756 Jun 22 09:07:28.854043 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 387/771] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:07:28 2022] POST /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:32.961038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0c22d12d-18c1-4ea5-8410-bbb33870880b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:32.961559 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0c22d12d-18c1-4ea5-8410-bbb33870880b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:32.967736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c22d12d-18c1-4ea5-8410-bbb33870880b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.968174 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c22d12d-18c1-4ea5-8410-bbb33870880b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.969052 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c22d12d-18c1-4ea5-8410-bbb33870880b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:32.969481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c22d12d-18c1-4ea5-8410-bbb33870880b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:32.993198 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0c22d12d-18c1-4ea5-8410-bbb33870880b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/ips" status: 200 len: 152 microversion: 2.20 time: 0.202002 Jun 22 09:07:32.993731 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 385/772] 10.222.0.36 () {60 vars in 1288 bytes} [Wed Jun 22 09:07:32 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/ips => generated 152 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:07:35.157782 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:35.158370 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:35.165354 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.165796 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.166596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.167030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.189755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lazy-loading 'flavor' on Instance uuid ea1ef288-3b6e-4369-8492-76898b858067 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:07:35.805875 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-543a3268-54a9-4570-b174-2a4ecbd9a4d1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/action" status: 202 len: 0 microversion: 2.20 time: 0.652827 Jun 22 09:07:35.806566 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 388/773] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 09:07:35 2022] POST /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:07:35.814652 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:35.815404 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:35.822677 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.823126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.823895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:35.824332 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:35.956559 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:35.964836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:35.966429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:35.967582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-97cfd869-a255-4ea3-a24b-48af8e0e5c60 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.156859 Jun 22 09:07:35.968120 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 386/774] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:35 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:36.987805 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:36.988626 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:36.995656 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.996101 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:36.996860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:36.997295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:37.136838 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:37.144787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:37.146896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:37.148038 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e58523c3-c90b-44c7-9f0e-7a2b64c89418 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.165679 Jun 22 09:07:37.148591 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 389/775] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:36 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:07:38.167345 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:38.167950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:38.174643 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.178583 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.178583 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.178583 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.308409 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:38.316361 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:38.317850 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:38.319041 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1237b1ce-8fdf-4e1a-8b39-020b06cebb08 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.155902 Jun 22 09:07:38.319592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 387/776] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:38 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:38.559539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:38.560063 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:38.566727 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.567180 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.568054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.568990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.651013 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lazy-loading 'services' on Instance uuid 7518373c-b425-4a1c-b01b-32912b5257d5 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:07:38.833566 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-81b44901-ca82-41fd-8ff0-6254a8d65c0d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments/6b1d121e-0132-45cc-a824-d21439858b0f" status: 202 len: 0 microversion: 2.1 time: 0.277798 Jun 22 09:07:38.834632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 390/777] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:07:38 2022] DELETE /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments/6b1d121e-0132-45cc-a824-d21439858b0f => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:07:38.842878 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c0127d0a-c970-415d-a7fb-a47e354fb353 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:38.843912 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c0127d0a-c970-415d-a7fb-a47e354fb353 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:38.850212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0127d0a-c970-415d-a7fb-a47e354fb353 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.850681 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0127d0a-c970-415d-a7fb-a47e354fb353 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.851431 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0127d0a-c970-415d-a7fb-a47e354fb353 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:38.851868 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c0127d0a-c970-415d-a7fb-a47e354fb353 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:38.881060 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c0127d0a-c970-415d-a7fb-a47e354fb353 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 Jun 22 09:07:38.882366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 388/778] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:38 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:39.337603 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:39.338333 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:39.344499 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.344944 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.345698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.346181 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.482523 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:39.491175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:39.492686 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:39.493829 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-301d5ba5-1572-4161-9f1f-1ac7a7786fde tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.160802 Jun 22 09:07:39.494422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 391/779] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:39 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:39.894923 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3d637bb8-d55d-4f57-b660-65d7ca1a5224 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:39.895857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3d637bb8-d55d-4f57-b660-65d7ca1a5224 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:39.902841 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3d637bb8-d55d-4f57-b660-65d7ca1a5224 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.903290 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3d637bb8-d55d-4f57-b660-65d7ca1a5224 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.904044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3d637bb8-d55d-4f57-b660-65d7ca1a5224 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:39.904475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3d637bb8-d55d-4f57-b660-65d7ca1a5224 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:39.933348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3d637bb8-d55d-4f57-b660-65d7ca1a5224 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042339 Jun 22 09:07:39.933894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 389/780] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:39 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:40.512533 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:40.513131 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:40.519599 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.520034 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.520778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.521204 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.655861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:40.664547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:40.665978 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:40.667261 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3941e714-ad47-4571-948f-e100d7d4a830 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.158630 Jun 22 09:07:40.667812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 392/781] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:40 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:40.945220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c03b9d94-6f36-4382-bbf0-2973c17e9537 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:40.946078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c03b9d94-6f36-4382-bbf0-2973c17e9537 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:40.952524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c03b9d94-6f36-4382-bbf0-2973c17e9537 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.952970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c03b9d94-6f36-4382-bbf0-2973c17e9537 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.953724 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c03b9d94-6f36-4382-bbf0-2973c17e9537 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:40.954188 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c03b9d94-6f36-4382-bbf0-2973c17e9537 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:40.983271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c03b9d94-6f36-4382-bbf0-2973c17e9537 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Jun 22 09:07:40.983818 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 390/782] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:40 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:41.685746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:41.686405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:41.694012 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.694491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.695249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:41.695681 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:41.876992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:41.885680 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:41.887208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:41.888359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-92ecf687-bb16-4af0-8771-8cbf93e28bca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.206560 Jun 22 09:07:41.888910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 393/783] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:41 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:41.997128 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-20869c9e-b7f2-47f4-b324-1f67b8b1ae8b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:41.998050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-20869c9e-b7f2-47f4-b324-1f67b8b1ae8b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:42.004716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20869c9e-b7f2-47f4-b324-1f67b8b1ae8b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.005164 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20869c9e-b7f2-47f4-b324-1f67b8b1ae8b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.006861 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20869c9e-b7f2-47f4-b324-1f67b8b1ae8b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.007455 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-20869c9e-b7f2-47f4-b324-1f67b8b1ae8b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.037385 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-20869c9e-b7f2-47f4-b324-1f67b8b1ae8b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Jun 22 09:07:42.038050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 391/784] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:41 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:42.906559 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:42.907195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:42.915253 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.915253 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:42.915855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:42.916285 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.049075 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-88d18d8c-9907-4337-9fcc-43a8c45fe7da tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:43.050289 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-88d18d8c-9907-4337-9fcc-43a8c45fe7da tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:43.052556 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:43.057480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-88d18d8c-9907-4337-9fcc-43a8c45fe7da tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.058011 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-88d18d8c-9907-4337-9fcc-43a8c45fe7da tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.058803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-88d18d8c-9907-4337-9fcc-43a8c45fe7da tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.059316 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-88d18d8c-9907-4337-9fcc-43a8c45fe7da tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.060775 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:43.062302 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:43.063453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-198980ed-6c48-4326-9411-32aab4531a8e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.160823 Jun 22 09:07:43.063997 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 394/785] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:42 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:43.091248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-88d18d8c-9907-4337-9fcc-43a8c45fe7da tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046074 Jun 22 09:07:43.091718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 392/786] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:07:43 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 09:07:43.150310 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:43.150838 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:43.157004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.157458 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.158271 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.158744 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.184780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:07:43.482943 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e682032a-5fcb-4073-8860-24e359fbae5b tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 204 len: 0 microversion: 2.1 time: 0.337161 Jun 22 09:07:43.483526 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 395/787] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:07:43 2022] DELETE /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:07:43.491828 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:43.492441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:43.498396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.499013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.499768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:43.500202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:43.630517 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:43.639313 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2157f880-ee0e-44af-8350-d849632906ce tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1679 microversion: 2.1 time: 0.151372 Jun 22 09:07:43.639889 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 393/788] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:43 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:44.082871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:44.083564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:44.089972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.091237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.091620 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.225246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:44.233515 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:44.235096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:44.236255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b0790eed-3742-43ec-9c67-54877512c126 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.157708 Jun 22 09:07:44.236808 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 396/789] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:44 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:44.657706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:44.658352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:44.665452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.665910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.666693 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:44.667135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:44.794304 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:44.801654 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-230992b3-b368-4ee7-bfe4-e475a903d0ea tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1679 microversion: 2.1 time: 0.147865 Jun 22 09:07:44.802242 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 394/790] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:44 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:45.254988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:45.256751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:45.264896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.265345 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.266137 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.266604 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.516168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:45.529092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:45.535929 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:45.537790 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:45.539185 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5f2236d6-abb2-4016-b7ff-e4bf7de97a13 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.287947 Jun 22 09:07:45.540188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 397/791] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:45 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:45.819080 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:45.821999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:45.828599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.829094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:45.829813 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:45.830275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.130910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.139596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ca8e0407-9f5d-45b8-88cf-0a963988909e tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1611 microversion: 2.1 time: 0.324490 Jun 22 09:07:46.140279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 395/792] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:45 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1611 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:46.359178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-5901133e-7744-43b5-ac86-0cf89f26e674 req-7ec978c6-be36-44a5-b42c-2332d828a165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7518373c-b425-4a1c-b01b-32912b5257d5", "name": "network-vif-deleted", "tag": "6638968f-6bd6-403a-a366-d6645776a688"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:46.363305 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-5901133e-7744-43b5-ac86-0cf89f26e674 req-7ec978c6-be36-44a5-b42c-2332d828a165 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.363954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-5901133e-7744-43b5-ac86-0cf89f26e674 req-7ec978c6-be36-44a5-b42c-2332d828a165 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.375928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-5901133e-7744-43b5-ac86-0cf89f26e674 req-7ec978c6-be36-44a5-b42c-2332d828a165 service nova] Creating event network-vif-deleted:6638968f-6bd6-403a-a366-d6645776a688 for instance 7518373c-b425-4a1c-b01b-32912b5257d5 on hv-cinder-78729 Jun 22 09:07:46.382052 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-5901133e-7744-43b5-ac86-0cf89f26e674 req-7ec978c6-be36-44a5-b42c-2332d828a165 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032119 Jun 22 09:07:46.382869 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 398/793] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:46.558970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:46.559753 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:46.565704 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.566176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.566928 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:46.567355 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:46.710417 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.719141 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.720895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:46.722086 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a57ca9ee-1629-4ae9-9487-a51307c538be tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.167229 Jun 22 09:07:46.733633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 396/794] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:46 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:47.159087 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:47.159783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:47.171638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.171638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.171638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.171638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.211023 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.211812 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.212432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lazy-loading 'fault' on Instance uuid 7518373c-b425-4a1c-b01b-32912b5257d5 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:07:47.286773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf981e5982644d708ddaba93a12b2b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c906f2149774a18b39228b7b6ef556f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:47.294807 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-07ea05ed-17fd-44b8-9fea-80b8f9d186db tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 200 len: 1331 microversion: 2.1 time: 0.140289 Jun 22 09:07:47.295345 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 399/795] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:47 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 1331 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:47.741269 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:47.741916 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:47.748445 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.748904 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.749637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:47.750079 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:47.887409 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:47.895470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:47.900706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:47.900706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7df9eb19-7673-4637-9bea-8273f22b7548 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.161294 Jun 22 09:07:47.900706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 397/796] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:47 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:48.311517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:48.312122 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:48.319134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.319606 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.320365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.320800 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.334517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 HTTP/1.1 Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:07:48.336159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:48.337809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '7518373c-b425-4a1c-b01b-32912b5257d5'} Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:48.338712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:48.340179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:48.341802 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:48.341802 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6b40d1fe-ad4a-462c-98e1-d23c0a8fdc74 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 404 len: 111 microversion: 2.1 time: 0.029895 Jun 22 09:07:48.341802 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 400/797] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:48 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:48.346129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f54f89c1-c4eb-4b55-9043-2ed8e4538421 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '.version_select at 0x7fb331f735e0>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:48.417801 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f54f89c1-c4eb-4b55-9043-2ed8e4538421 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768541412" status: 202 len: 0 microversion: 2.1 time: 0.075362 Jun 22 09:07:48.418408 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 398/798] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Jun 22 09:07:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768541412 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:07:48.917182 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:48.917791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:48.923904 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.924356 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:48.925133 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:48.925571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:49.064273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:49.072966 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:49.075832 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:49.075832 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f1ef27d9-48de-41dd-95ab-7426f9881e19 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.162325 Jun 22 09:07:49.076459 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 401/799] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:48 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:07:50.094567 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:50.095163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:50.101344 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.101792 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.102586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.103028 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.231494 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:50.239393 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:50.240886 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:50.242178 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-bc47d817-313f-4b5d-8fb7-265bc78715fe tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.152047 Jun 22 09:07:50.242731 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 399/800] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:50 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:50.711343 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:50.711878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:50.718512 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.722378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.722378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.722378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.733608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 HTTP/1.1 Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:07:50.735167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.736689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '7518373c-b425-4a1c-b01b-32912b5257d5'} Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:50.737654 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.739241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.740920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:50.740920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ca5b7c46-47b0-43f6-a673-16d8dc1ce868 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 404 len: 111 microversion: 2.1 time: 0.029220 Jun 22 09:07:50.740920 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 402/801] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:07:50 2022] DELETE /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:50.746369 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:50.751001 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 7518373c-b425-4a1c-b01b-32912b5257d5] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:50.753208 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.753650 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.754430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:50.754881 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:50.769038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 HTTP/1.1 Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:07:50.774039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.775687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '7518373c-b425-4a1c-b01b-32912b5257d5'} Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:50.776550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. Jun 22 09:07:50.777995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:50.779991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance 7518373c-b425-4a1c-b01b-32912b5257d5 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:50.779991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9bd4a06c-e036-42ed-bc01-c6d453352444 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5" status: 404 len: 111 microversion: 2.1 time: 0.029755 Jun 22 09:07:50.779991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 400/802] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:50 2022] GET /compute/v2.1/servers/7518373c-b425-4a1c-b01b-32912b5257d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:51.260787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:51.261394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:51.267619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.268066 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.268828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:51.269259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:51.403535 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:51.411807 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:51.414519 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:51.415738 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f441d0ae-a262-42b6-8f6f-7c71ec856488 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.159135 Jun 22 09:07:51.416375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 403/803] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:51 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:52.058331 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.058924 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.067056 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.067450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.068362 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.068837 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.086134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: DELETE /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 HTTP/1.1 Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:07:52.087960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.089540 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'f943d146-cb3d-4f92-816a-536fc8e77c88'} Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:52.090441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.091653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.092910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:52.092910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fa426fef-739a-4c1d-9dfc-15ff9a0e0a4f tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 404 len: 111 microversion: 2.1 time: 0.038924 Jun 22 09:07:52.092910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 401/804] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:07:52 2022] DELETE /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:52.098254 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.100704 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: f943d146-cb3d-4f92-816a-536fc8e77c88] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.106127 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.106556 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.107326 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.107763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.121983 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 HTTP/1.1 Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:07:52.123576 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.125169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'f943d146-cb3d-4f92-816a-536fc8e77c88'} Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:52.126046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. Jun 22 09:07:52.130810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.132452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance f943d146-cb3d-4f92-816a-536fc8e77c88 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:52.132452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9275ba07-0325-4f7a-88b9-3e40208998c8 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88" status: 404 len: 111 microversion: 2.1 time: 0.030621 Jun 22 09:07:52.132452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 404/805] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:52 2022] GET /compute/v2.1/servers/f943d146-cb3d-4f92-816a-536fc8e77c88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:52.134586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.135117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.141322 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.141767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.142582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.143020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.160714 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: DELETE /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 HTTP/1.1 Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:07:52.162534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.164352 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'cb3f60b3-c6b7-473b-97a3-a83de42be721'} Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:52.165177 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.166558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.167824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:52.167824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2a113ab3-98bd-4d72-b2d8-fdb8fc58271d tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 404 len: 111 microversion: 2.1 time: 0.034536 Jun 22 09:07:52.167824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 402/806] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:07:52 2022] DELETE /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:52.173396 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.175827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: cb3f60b3-c6b7-473b-97a3-a83de42be721] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.182644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.186872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.186872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.186872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.198249 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 HTTP/1.1 Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:07:52.199768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.201151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'cb3f60b3-c6b7-473b-97a3-a83de42be721'} Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:52.201866 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. Jun 22 09:07:52.203177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:52.204363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance cb3f60b3-c6b7-473b-97a3-a83de42be721 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:52.204363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f79df569-aac3-4bc7-b4d3-aad60cf9cbb1 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721" status: 404 len: 111 microversion: 2.1 time: 0.031692 Jun 22 09:07:52.204363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 405/807] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:52 2022] GET /compute/v2.1/servers/cb3f60b3-c6b7-473b-97a3-a83de42be721 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:52.434200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.434883 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.441075 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.441593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.442436 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.442967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.592880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:52.601673 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:52.603230 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:52.604699 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-22f13b42-e0d6-4619-a985-2295e348bfcb tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.174510 Jun 22 09:07:52.605242 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 403/808] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:52 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:52.890088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:52.890574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:52.896336 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-788894b7-0662-4413-b796-da96673a8531 req-b0eb4c16-e938-4ab5-b075-619215bba626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7dd4b24-61df-4868-a828-c99798580375", "tag": "8322d52e-16ae-49fa-a614-eacc8025f50d"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:52.897151 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.897686 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.898961 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.899394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.905100 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-788894b7-0662-4413-b796-da96673a8531 req-b0eb4c16-e938-4ab5-b075-619215bba626 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:52.905654 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-788894b7-0662-4413-b796-da96673a8531 req-b0eb4c16-e938-4ab5-b075-619215bba626 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:52.909708 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=100 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:52.918238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-788894b7-0662-4413-b796-da96673a8531 req-b0eb4c16-e938-4ab5-b075-619215bba626 service nova] Creating event network-changed:8322d52e-16ae-49fa-a614-eacc8025f50d for instance c7dd4b24-61df-4868-a828-c99798580375 on hv-cinder-78729 Jun 22 09:07:52.923564 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-788894b7-0662-4413-b796-da96673a8531 req-b0eb4c16-e938-4ab5-b075-619215bba626 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031128 Jun 22 09:07:52.925008 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 404/809] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:52.926220 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:07:53.417168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9f6b124f-8df5-4dc4-a04b-3bbaa6bb8417 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 204 len: 0 microversion: 2.1 time: 0.531243 Jun 22 09:07:53.421276 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 406/810] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:07:52 2022] DELETE /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:07:53.432029 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:53.433348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:53.440769 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.441449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.442397 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.442975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.521488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:53.523428 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:53.532177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.533528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.535024 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.536767 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.558605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 HTTP/1.1 Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:07:53.560636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.562017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '4728bbe3-835f-4432-b8a2-bd1ff5352341'} Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:53.562821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.564020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.565193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:53.565193 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d962c873-6184-4c93-a624-963a8f6a08ad tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 404 len: 111 microversion: 2.1 time: 0.046416 Jun 22 09:07:53.565797 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 407/811] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:07:53 2022] DELETE /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:07:53.570722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:53.571326 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] [instance: 4728bbe3-835f-4432-b8a2-bd1ff5352341] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:53.579581 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.580024 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.583888 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.583888 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.598647 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] HTTP exception thrown: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Request method failure captured: Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 HTTP/1.1 Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistpByg9tmIRMSlLrs19fM0UfZSGEOZGnIlF4A-cj6eUYyqSI-E3EyE9o4rQ14WaV9bm7frDZ9O_no_bpu8KRibMiDXG20iYdLsGMgSSNKRiEpNdZKvjwlT3X6gIcsikMspx7F6Ci3qhT4qTqTFHY351iEiSXPpoB85ykFYlSI_56K4w Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:07:53.600351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c906f2149774a18b39228b7b6ef556f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c906f2149774a18b39228b7b6ef556f"}]}] Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 3c906f2149774a18b39228b7b6ef556f Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398890423 Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: cf981e5982644d708ddaba93a12b2b27 Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeNegativeTest-398890423-project Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.602643 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '4728bbe3-835f-4432-b8a2-bd1ff5352341'} Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:53.603673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. Jun 22 09:07:53.605406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:53.613001 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] Returning 404 to user: Instance 4728bbe3-835f-4432-b8a2-bd1ff5352341 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:53.613001 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9076a3bb-dc3f-443e-a224-0d88037026c3 tempest-AttachVolumeNegativeTest-398890423 tempest-AttachVolumeNegativeTest-398890423-project] 10.222.0.36 "GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341" status: 404 len: 111 microversion: 2.1 time: 0.037738 Jun 22 09:07:53.613001 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 408/812] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:53 2022] GET /compute/v2.1/servers/4728bbe3-835f-4432-b8a2-bd1ff5352341 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:53.626467 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:53.627218 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:53.631407 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:53.634392 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.634900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.635925 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:53.636550 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:53.653756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-935a75bc-5d09-480a-a12a-1f3a82b198e7 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.216894 Jun 22 09:07:53.653756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 405/813] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:53 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:07:53.786706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:53.798846 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:53.801632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:53.804775 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-93336f99-3285-45af-aa50-e6a3ea22a62d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1744 microversion: 2.20 time: 0.183446 Jun 22 09:07:53.805469 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 409/814] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:53 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:54.660723 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:54.661420 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:54.669939 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.673788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.673788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.673788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.825241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:54.829042 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:54.837819 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.838351 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:54.838765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.839737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:54.840320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:54.848280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e22394d3-910d-4f48-98ac-6ab1ee61a225 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1569 microversion: 2.1 time: 0.191342 Jun 22 09:07:54.854212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 406/815] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:54 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:55.010108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.018531 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.023468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.023468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-87eec13b-bfbf-4a96-9a9a-5790f0cadd2e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1744 microversion: 2.20 time: 0.200647 Jun 22 09:07:55.023468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 410/816] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:54 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:07:55.816518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-0e747c89-f53d-498c-8292-0fe0962ecb7d req-9f76b43a-5821-41da-ac87-ab634b296c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7dd4b24-61df-4868-a828-c99798580375", "name": "network-vif-deleted", "tag": "8322d52e-16ae-49fa-a614-eacc8025f50d"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:55.828328 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0e747c89-f53d-498c-8292-0fe0962ecb7d req-9f76b43a-5821-41da-ac87-ab634b296c3e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.828766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0e747c89-f53d-498c-8292-0fe0962ecb7d req-9f76b43a-5821-41da-ac87-ab634b296c3e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.840509 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-0e747c89-f53d-498c-8292-0fe0962ecb7d req-9f76b43a-5821-41da-ac87-ab634b296c3e service nova] Creating event network-vif-deleted:8322d52e-16ae-49fa-a614-eacc8025f50d for instance c7dd4b24-61df-4868-a828-c99798580375 on hv-cinder-78729 Jun 22 09:07:55.845954 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-0e747c89-f53d-498c-8292-0fe0962ecb7d req-9f76b43a-5821-41da-ac87-ab634b296c3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Jun 22 09:07:55.846702 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 407/817] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:07:55.869464 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:55.870186 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:55.878689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.879229 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.880069 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:55.880596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:55.984622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:55.995023 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3264ba67-94f6-44c2-831d-fd062a7a33ee tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1383 microversion: 2.1 time: 0.130337 Jun 22 09:07:56.004945 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 411/818] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:55 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1383 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:56.041555 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:56.042335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:56.048990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.049692 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.050835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:56.051421 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:56.281703 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:56.296382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:56.308842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:56.308842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d9f4b366-9bee-474a-aa0d-b520ca6f56ae tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.268650 Jun 22 09:07:56.321964 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 408/819] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:56 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:57.015340 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:57.023504 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:57.080328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.081400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.085757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.092884 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.149910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.162239 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.163927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lazy-loading 'fault' on Instance uuid c7dd4b24-61df-4868-a828-c99798580375 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:07:57.179734 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-31d634c8-2cfb-4801-bfeb-1369520bcc5a req-b282cd10-6a23-4812-ace5-fa983d62509b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1ef288-3b6e-4369-8492-76898b858067", "name": "network-vif-plugged", "status": "completed", "tag": "f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:07:57.207554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-31d634c8-2cfb-4801-bfeb-1369520bcc5a req-b282cd10-6a23-4812-ace5-fa983d62509b service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.210584 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-31d634c8-2cfb-4801-bfeb-1369520bcc5a req-b282cd10-6a23-4812-ace5-fa983d62509b service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.244935 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-31d634c8-2cfb-4801-bfeb-1369520bcc5a req-b282cd10-6a23-4812-ace5-fa983d62509b service nova] Creating event network-vif-plugged:f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f for instance ea1ef288-3b6e-4369-8492-76898b858067 on hv-cinder-78729 Jun 22 09:07:57.251313 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-31d634c8-2cfb-4801-bfeb-1369520bcc5a req-b282cd10-6a23-4812-ace5-fa983d62509b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075908 Jun 22 09:07:57.259796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 409/820] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:07:57.259993 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9848da15ea4ddfbceaf556423ba852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cc58068dc749479b723b40a455c8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.272982 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-38b66e80-3549-44ba-8bdf-271fd22851c1 tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 200 len: 1225 microversion: 2.1 time: 0.261018 Jun 22 09:07:57.284987 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 412/821] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:57 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 1225 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:07:57.330366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:57.331227 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:57.350943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.351883 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.352919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:57.353830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:57.638448 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.661558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.663611 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:57.669020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ca991e03-8571-407b-9547-eb82caa85991 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.345017 Jun 22 09:07:57.669905 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 410/822] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:57 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:07:58.298656 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:58.301934 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] [instance: c7dd4b24-61df-4868-a828-c99798580375] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:58.316745 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.317264 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.320440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.320887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.358940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] HTTP exception thrown: Instance c7dd4b24-61df-4868-a828-c99798580375 could not be found. Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Request method failure captured: Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 HTTP/1.1 Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistqlp2DrkOeRvmeAGj6f92wmfe0FgfLy0hUVQTxEc3CZfQQTM7Q7uQep1AlXzNzV3PTJX6Zp7Dt0b8nb0nPnNIZDP-3zwgXun2d2hBgFlqEuSxaGE06S-52tquXkge3J_XoQixU-dkJH0W9hp0JUw_oPTl2uEYdGDQLa1NX3qOLEzbQ Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 88cc58068dc749479b723b40a455c8c3 Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-TestShelveInstance-912037290 Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:07:58.361638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/88cc58068dc749479b723b40a455c8c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/88cc58068dc749479b723b40a455c8c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_88cc58068dc749479b723b40a455c8c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/88cc58068dc749479b723b40a455c8c3"}]}] Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-TestShelveInstance-912037290 Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 88cc58068dc749479b723b40a455c8c3 Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-TestShelveInstance-912037290 Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-TestShelveInstance-912037290-project Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 9e9848da15ea4ddfbceaf556423ba852 Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-TestShelveInstance-912037290-project Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance c7dd4b24-61df-4868-a828-c99798580375 could not be found. Jun 22 09:07:58.363234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'c7dd4b24-61df-4868-a828-c99798580375'} Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7dd4b24-61df-4868-a828-c99798580375 could not be found. Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:07:58.364224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7dd4b24-61df-4868-a828-c99798580375 could not be found. Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7dd4b24-61df-4868-a828-c99798580375 could not be found. Jun 22 09:07:58.365642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:07:58.367321 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Returning 404 to user: Instance c7dd4b24-61df-4868-a828-c99798580375 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:07:58.367992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2dceca24-4979-4835-b4ee-1699914f72df tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375" status: 404 len: 111 microversion: 2.1 time: 0.075397 Jun 22 09:07:58.373832 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 413/823] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:07:58 2022] GET /compute/v2.1/servers/c7dd4b24-61df-4868-a828-c99798580375 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:58.699885 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:58.700529 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:07:58.702321 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e52d688b-3cae-4274-9b58-0fe2c5a188fb tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] Calling method '.version_select at 0x7fb331e8b1f0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:07:58.717441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:58.737521 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.737521 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.739218 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:07:58.748194 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:07:58.789425 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e52d688b-3cae-4274-9b58-0fe2c5a188fb tempest-TestShelveInstance-912037290 tempest-TestShelveInstance-912037290-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1316151461" status: 202 len: 0 microversion: 2.1 time: 0.091040 Jun 22 09:07:58.790275 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 414/824] 10.222.0.36 () {58 vars in 1253 bytes} [Wed Jun 22 09:07:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1316151461 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:07:59.041063 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:59.052654 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:59.057687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:07:59.060346 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-048d2979-52ea-4f13-9072-e2ad274e4228 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.376679 Jun 22 09:07:59.061251 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 411/825] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:07:58 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:00.083164 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:00.084295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:00.093765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:00.094247 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:00.095044 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:00.095478 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:00.373242 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:00.394363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:00.395942 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:00.397664 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4954f312-bdd1-4e2a-9271-b1588960a6f4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.320464 Jun 22 09:08:00.398253 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 415/826] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:00 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:01.417202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:01.418512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:01.435903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:01.439671 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:01.445025 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:01.446555 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:02.008812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:02.023340 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:02.024941 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:02.026207 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1f456b0a-aa9c-42c0-97f7-122e44b636f6 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.614053 Jun 22 09:08:02.027917 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 412/827] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:01 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:03.046506 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:03.047162 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:03.068579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:03.069513 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:03.070530 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:03.071148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:03.287148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:03.317051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:03.318781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:03.320187 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-91c3f365-3070-4769-a845-9906156adcbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.279033 Jun 22 09:08:03.321381 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 416/828] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:03 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:04.340441 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:04.342279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:04.345077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:04.351030 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:04.351797 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:04.352756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:04.353439 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:04.579523 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:04.589166 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:04.591338 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:04.592715 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ad2aa14f-b28d-4676-b929-16d586a519ca tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.256081 Jun 22 09:08:04.593685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 413/829] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:04 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:05.612719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:05.613353 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:05.621450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:05.621900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:05.622863 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:05.623291 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:05.846809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:05.858954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:05.860666 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:05.862140 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ebeb095b-6daa-4853-a13e-ab8571b2e272 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.253253 Jun 22 09:08:05.863199 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 417/830] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:05 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:06.880895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:06.882793 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:06.892428 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:06.894644 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:06.895625 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:06.896430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:07.086744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:07.109545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:07.109545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:07.109545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dbef0b72-7cc3-47d9-823c-a4504bd16da4 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.221390 Jun 22 09:08:07.109872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 414/831] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:06 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:08.121143 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:08.122270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:08.145372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:08.149255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:08.149255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:08.149255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:08.176600 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:08.409184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:08.433801 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:08.435363 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:08.438902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8b982c13-de96-418d-b3c4-1ace9bce7efc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.323425 Jun 22 09:08:08.439945 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 418/832] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:08 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:09.459492 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:09.460452 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:09.468409 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:09.469147 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:09.469945 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:09.470435 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:09.662267 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:09.671991 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:09.673787 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:09.675226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fbacc4cf-27ca-4236-a282-90e1b3052c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.219767 Jun 22 09:08:09.675868 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 415/833] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:09 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:10.695726 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:10.696323 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:10.708060 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:10.708488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:10.709842 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:10.710420 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:10.969793 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:10.980404 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:10.982345 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:10.983899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b51312fb-8dbd-4a5b-9fa3-e6c2c41cb366 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1739 microversion: 2.20 time: 0.292548 Jun 22 09:08:10.997164 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 419/834] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:10 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:12.002763 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:12.003366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:12.010883 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:12.011327 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:12.012085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:12.012522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:12.191161 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:12.201079 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:12.202674 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:12.204058 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-29d8682a-e2fd-4c99-ae20-d102b854f6ed tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1721 microversion: 2.20 time: 0.205273 Jun 22 09:08:12.205142 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 416/835] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:11 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:13.223490 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:13.224116 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:13.230952 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:13.231411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:13.233179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:13.233179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:13.368308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:13.377178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:13.378791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:13.379930 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-03b0e64f-6842-4495-8aa8-4aeff800b336 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1721 microversion: 2.20 time: 0.160352 Jun 22 09:08:13.380480 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 420/836] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:13 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:14.398590 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:14.399245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:14.406347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:14.407059 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:14.408114 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:14.408830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:14.549931 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:14.559361 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:14.561078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:14.562265 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-71239277-40fa-4e0d-878c-e51d8366830a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1721 microversion: 2.20 time: 0.167702 Jun 22 09:08:14.562813 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 417/837] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:14 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:15.581655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:15.582211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:15.588771 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:15.589212 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:15.590243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:15.590678 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:15.739138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:15.748341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:15.749824 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:15.751111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d025c2c3-f00a-4b2f-8434-17ea814543aa tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1664 microversion: 2.20 time: 0.173899 Jun 22 09:08:15.751835 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 421/838] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:15 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:15.770508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ed196766-75cf-4bba-ae0a-3e0571ed22df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be3cf3a2-eb5a-4eef-9e62-c00d19bc6f04"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:15.771576 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ed196766-75cf-4bba-ae0a-3e0571ed22df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:15.779472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed196766-75cf-4bba-ae0a-3e0571ed22df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:15.780097 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed196766-75cf-4bba-ae0a-3e0571ed22df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:15.781133 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed196766-75cf-4bba-ae0a-3e0571ed22df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:15.781580 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ed196766-75cf-4bba-ae0a-3e0571ed22df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:17.097669 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-b82ba6b6-ba1c-49b3-88b1-a1ff37b57f41 req-5a20a621-44c6-4393-aa06-1baeaefea22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1ef288-3b6e-4369-8492-76898b858067", "name": "network-vif-unplugged", "status": "completed", "tag": "f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:17.106876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-b82ba6b6-ba1c-49b3-88b1-a1ff37b57f41 req-5a20a621-44c6-4393-aa06-1baeaefea22c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:17.107315 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-b82ba6b6-ba1c-49b3-88b1-a1ff37b57f41 req-5a20a621-44c6-4393-aa06-1baeaefea22c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:17.118715 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.compute.server_external_events [req-b82ba6b6-ba1c-49b3-88b1-a1ff37b57f41 req-5a20a621-44c6-4393-aa06-1baeaefea22c service nova] Unable to find a host for instance ea1ef288-3b6e-4369-8492-76898b858067. Dropping event network-vif-unplugged {{(pid=118028) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 09:08:17.119569 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-b82ba6b6-ba1c-49b3-88b1-a1ff37b57f41 req-5a20a621-44c6-4393-aa06-1baeaefea22c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025884 Jun 22 09:08:17.120196 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 422/839] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 22 09:08:17.290618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ed196766-75cf-4bba-ae0a-3e0571ed22df tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.524375 Jun 22 09:08:17.291442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 418/840] 10.222.0.36 () {62 vars in 1363 bytes} [Wed Jun 22 09:08:15 2022] POST /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-volume_attachments => generated 188 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 09:08:17.457867 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-80fc98da-f7e8-49ec-b1f3-20f729f31f1b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:17.458395 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-80fc98da-f7e8-49ec-b1f3-20f729f31f1b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:17.464675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80fc98da-f7e8-49ec-b1f3-20f729f31f1b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:17.465119 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80fc98da-f7e8-49ec-b1f3-20f729f31f1b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:17.465874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80fc98da-f7e8-49ec-b1f3-20f729f31f1b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:17.466332 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-80fc98da-f7e8-49ec-b1f3-20f729f31f1b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.204698 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-80fc98da-f7e8-49ec-b1f3-20f729f31f1b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-volume_attachments/be3cf3a2-eb5a-4eef-9e62-c00d19bc6f04" status: 202 len: 0 microversion: 2.20 time: 0.751106 Jun 22 09:08:18.205389 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 423/841] 10.222.0.36 () {60 vars in 1456 bytes} [Wed Jun 22 09:08:17 2022] DELETE /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-volume_attachments/be3cf3a2-eb5a-4eef-9e62-c00d19bc6f04 => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:08:18.262748 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ef36ea43-34ce-4975-8953-2c0f494ee9a2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:18.263309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ef36ea43-34ce-4975-8953-2c0f494ee9a2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:18.270604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef36ea43-34ce-4975-8953-2c0f494ee9a2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:18.271047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef36ea43-34ce-4975-8953-2c0f494ee9a2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.271797 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef36ea43-34ce-4975-8953-2c0f494ee9a2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:18.272225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef36ea43-34ce-4975-8953-2c0f494ee9a2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.331431 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:18.514306 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ef36ea43-34ce-4975-8953-2c0f494ee9a2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "POST /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/action" status: 202 len: 0 microversion: 2.20 time: 0.255303 Jun 22 09:08:18.515725 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 419/842] 10.222.0.36 () {62 vars in 1318 bytes} [Wed Jun 22 09:08:18 2022] POST /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:08:18.524341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:18.525231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:18.537329 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:18.537329 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.537329 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:18.537329 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:18.703258 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:18.711339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:18.712832 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:18.713985 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-54336c10-ee18-4975-8f24-1553d3582b73 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1672 microversion: 2.20 time: 0.193896 Jun 22 09:08:18.714564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 424/843] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:18 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:19.734975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:19.735597 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:19.741850 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.742244 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.743041 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:19.743480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:19.912429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:19.920367 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:19.921857 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:19.923030 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-64d5ea1b-b575-4422-be66-a52294d7662a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1672 microversion: 2.20 time: 0.193866 Jun 22 09:08:19.923578 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 420/844] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:19 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:20.941578 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:20.942146 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:20.948999 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.949450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:20.950355 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:20.950791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:21.098937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:21.107148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:21.109365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:21.110556 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-484b6746-7751-48ff-9828-10e81f37b6cf tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1672 microversion: 2.20 time: 0.173102 Jun 22 09:08:21.111098 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 425/845] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:20 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:22.131543 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:22.132131 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:22.141598 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:22.142044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:22.143093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:22.143525 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:22.295368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:22.304470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:22.306295 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:22.307534 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4a6181dc-8c31-4b02-8f0e-7f29dff7bcf7 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1674 microversion: 2.20 time: 0.179851 Jun 22 09:08:22.308181 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 421/846] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:22 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:23.328142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:23.332491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:23.337134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:23.337627 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:23.338594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:23.339197 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:23.482070 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:23.491113 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:23.492573 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:23.493734 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3b64a4cb-9d0c-4701-9c99-c4ce53f25c3e tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.170368 Jun 22 09:08:23.494479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 426/847] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:23 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:24.513626 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:24.514575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:24.522344 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.522793 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.523553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:24.523987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:24.727085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:24.741777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:24.743497 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:24.744851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c4dd597c-9146-47a2-9b00-927956dfecef tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.235747 Jun 22 09:08:24.758120 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 422/848] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:24 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:25.765037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:25.765636 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:25.772714 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.773499 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.774649 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:25.775328 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:25.922453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:25.933110 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:25.934835 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:25.937152 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-13be3440-7bde-4e5a-a750-a4e006f4f288 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.175176 Jun 22 09:08:25.939145 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 427/849] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:25 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:26.958571 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:26.959647 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:26.966309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:26.966763 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:26.968200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:26.968615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:27.128586 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:27.137099 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:27.138596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:27.141366 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-84034f6a-6e2b-4279-9124-57d8caefb578 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.187555 Jun 22 09:08:27.152448 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 423/850] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:26 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:28.161426 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:28.162028 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:28.173258 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:28.173711 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:28.174739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:28.175454 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:28.320859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:28.329871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:28.331879 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:28.333405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ee3ede28-0ae7-440a-ad93-2619ec0a378b tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.176342 Jun 22 09:08:28.344700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 428/851] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:28 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:29.352747 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:29.353617 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:29.362019 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.370150 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.371207 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:29.371808 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:29.607698 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:29.618671 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:29.620934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:29.622548 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e19c4d83-33a4-48cc-9865-eac4b5650347 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.274620 Jun 22 09:08:29.629637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 424/852] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:29 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:30.643427 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:30.644655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:30.648417 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:30.652112 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:30.652762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:30.653530 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:30.653961 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:30.814727 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:30.823419 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:30.825157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:30.827279 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d74ac555-b732-460a-bb0f-25e5de2a9d97 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.187344 Jun 22 09:08:30.827982 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 429/853] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:30 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:31.847515 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:31.848147 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:31.854424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:31.854901 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:31.855655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:31.856086 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:32.000750 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:32.008942 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:32.010522 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:32.011741 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-267f9b1d-bb25-4c90-97a1-29fa9bc7f977 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.169717 Jun 22 09:08:32.012291 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 425/854] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:31 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:33.032213 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:33.033048 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:33.040824 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:33.041555 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:33.042669 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:33.043483 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:33.199931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:33.208827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:33.210459 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:33.211705 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b7c98b7a-f374-497d-9dcc-5c3ad5ec8330 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.184608 Jun 22 09:08:33.212256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 430/855] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:33 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:34.231180 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:34.231789 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:34.239168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:34.239616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:34.240377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:34.240812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:34.380095 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:34.388052 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:34.389532 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:34.390709 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0ed0f3b4-2651-454b-950d-74742ed7dd17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.163857 Jun 22 09:08:34.391252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 426/856] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:34 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:35.031012 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-209614075", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "networks": [{"uuid": "1fc6598b-8630-43a0-8fc7-8a555dfcd6af"}]}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:35.083746 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] validate_networks() for [('1fc6598b-8630-43a0-8fc7-8a555dfcd6af', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:08:35.412358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:35.413469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:35.416903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=30 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:35.428045 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:35.428434 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:35.429701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:35.429701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:35.488201 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:08:35.488619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:08:35.489098 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:08:35.489503 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:08:35.489911 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:08:35.499583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:35.500295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:35.501084 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:35.501513 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:35.520264 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Getting quotas for project d2c631e8f3d544309a09e7bf6e39f780. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:08:35.524823 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Getting quotas for user 6b9e8a4e5a51463c826c821375c1d28c and project d2c631e8f3d544309a09e7bf6e39f780. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:08:35.542773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:08:35.545093 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:08:35.593411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:35.603189 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:35.604727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:35.614249 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-57dd5a94-c85e-453a-a950-dc8d4c7d925c tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.201112 Jun 22 09:08:35.618274 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 427/857] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:35 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:36.634707 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:36.635375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:36.642314 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:36.642762 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:36.644111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:36.644556 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:36.766022 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2f8cf5b9-6a3d-4805-a9cd-baba3cbd559f tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.739089 Jun 22 09:08:36.771822 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 431/858] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:08:36.777033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6c2709fb-d5d5-44fd-86e4-ace3cff2e6f9 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:36.777907 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6c2709fb-d5d5-44fd-86e4-ace3cff2e6f9 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:36.782204 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:36.795059 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:36.796500 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:36.798396 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7b2e5acb-05c8-4930-8aed-f0eef7746415 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.167196 Jun 22 09:08:36.798945 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 428/859] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:36 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:36.862205 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6c2709fb-d5d5-44fd-86e4-ace3cff2e6f9 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:36.871632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6c2709fb-d5d5-44fd-86e4-ace3cff2e6f9 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1218 microversion: 2.1 time: 0.096165 Jun 22 09:08:36.871632 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 432/860] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:36 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:37.345444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-ff460e6b-38f3-42f4-8235-36c97ef4694d req-bdb554d2-7dd5-455a-add3-0164639619e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1ef288-3b6e-4369-8492-76898b858067", "name": "network-vif-plugged", "status": "completed", "tag": "f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:37.354885 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-ff460e6b-38f3-42f4-8235-36c97ef4694d req-bdb554d2-7dd5-455a-add3-0164639619e2 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:37.355318 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-ff460e6b-38f3-42f4-8235-36c97ef4694d req-bdb554d2-7dd5-455a-add3-0164639619e2 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:37.368078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-ff460e6b-38f3-42f4-8235-36c97ef4694d req-bdb554d2-7dd5-455a-add3-0164639619e2 service nova] Creating event network-vif-plugged:f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f for instance ea1ef288-3b6e-4369-8492-76898b858067 on hv-cinder-78729 Jun 22 09:08:37.373038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-ff460e6b-38f3-42f4-8235-36c97ef4694d req-bdb554d2-7dd5-455a-add3-0164639619e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 Jun 22 09:08:37.374686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 429/861] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:37.817339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:37.818572 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:37.827130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:37.827130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:37.827130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:37.827130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:37.891001 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-14d19915-bf75-43a6-bd21-26db4caae50d tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:37.893591 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-14d19915-bf75-43a6-bd21-26db4caae50d tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:37.962378 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-14d19915-bf75-43a6-bd21-26db4caae50d tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:37.970888 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-14d19915-bf75-43a6-bd21-26db4caae50d tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1218 microversion: 2.1 time: 0.086812 Jun 22 09:08:37.971642 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 430/862] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:37 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:08:37.994718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:38.003537 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:38.005016 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:38.006887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-778da458-7431-4449-9b2b-9fea45a16a5a tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.193593 Jun 22 09:08:38.007440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 433/863] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:37 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:38.987946 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:38.988575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:38.995785 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:38.996277 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:38.997083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:38.997512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:39.025518 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:39.026946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:39.046571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:39.047120 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:39.048015 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:39.048456 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:39.071651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:39.084730 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5cdfaa56-acfb-45c0-9de8-eec74738f714 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1270 microversion: 2.1 time: 0.100671 Jun 22 09:08:39.086589 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 431/864] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:38 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:39.213821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:39.220183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:39.221988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:39.223229 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0071d41f-90c3-43ac-b3c4-a9de9d08d90d tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.202332 Jun 22 09:08:39.223949 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 434/865] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:39 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:08:40.101670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:40.105788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:40.109356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.109816 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:40.110607 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.111032 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:40.242984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:40.244807 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:40.250320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.250779 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:40.251571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:40.252083 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:40.256333 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:40.362593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:40.370153 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-55836ef8-7560-48f8-93b8-0419947868e6 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.272244 Jun 22 09:08:40.374954 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 432/866] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:40 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:40.424288 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:40.432002 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:40.433482 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:40.434708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-54528094-40a7-42d8-97b4-324671153b17 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1730 microversion: 2.20 time: 0.195672 Jun 22 09:08:40.435262 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 435/867] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:40 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:41.200892 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-41bbdeec-32d7-41cb-971a-04af04187116 req-a8ba09a3-f1b8-4837-9b7d-403d017f60eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b", "tag": "daed8555-b3cf-4de0-a0ee-64e47eda395e"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:41.210944 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-41bbdeec-32d7-41cb-971a-04af04187116 req-a8ba09a3-f1b8-4837-9b7d-403d017f60eb service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:41.211380 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-41bbdeec-32d7-41cb-971a-04af04187116 req-a8ba09a3-f1b8-4837-9b7d-403d017f60eb service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:41.228365 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-41bbdeec-32d7-41cb-971a-04af04187116 req-a8ba09a3-f1b8-4837-9b7d-403d017f60eb service nova] Creating event network-changed:daed8555-b3cf-4de0-a0ee-64e47eda395e for instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b on hv-cinder-78729 Jun 22 09:08:41.230389 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-41bbdeec-32d7-41cb-971a-04af04187116 req-a8ba09a3-f1b8-4837-9b7d-403d017f60eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034233 Jun 22 09:08:41.231055 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 433/868] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:41.387509 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:41.388121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:41.395335 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:41.402174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:41.402174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:41.402174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:41.455541 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:41.456151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:41.462524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:41.463029 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:41.463787 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:41.464223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:41.697013 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:41.704214 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:41.705162 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-56f9e5a6-480d-41df-97ee-96710fadec19 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.321838 Jun 22 09:08:41.705897 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 436/869] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:41 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:41.713488 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:41.715362 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:41.716613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-700c970e-2546-412f-b308-18114aa0adbd tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1717 microversion: 2.20 time: 0.265663 Jun 22 09:08:41.717271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 434/870] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:08:41 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1717 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 09:08:42.722285 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:42.722859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:42.729524 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:42.729964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:42.730790 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:42.731221 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:42.863144 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:42.870731 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fd01ced7-fca8-46aa-a56d-283405a882d0 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.153177 Jun 22 09:08:42.872045 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 437/871] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:42 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:43.887744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:43.888356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:43.895168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:43.895621 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:43.896381 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:43.897149 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:44.030019 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:44.037849 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d7dd0807-6f5f-473b-adcc-93c5b480dc14 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.153988 Jun 22 09:08:44.038435 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 435/872] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:43 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:45.056057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:45.056057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:45.062718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:45.063195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:45.064729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:45.065161 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:45.210184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:45.218089 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-79c07c43-1cc0-40fe-b8ef-4cece89a2c09 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.167169 Jun 22 09:08:45.218667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 438/873] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:45 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:46.241900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:46.242616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:46.249093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:46.249547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:46.250344 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:46.250893 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:46.384226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:46.392387 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-49d83a8d-852d-48c6-ac96-306fb4965554 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.154360 Jun 22 09:08:46.393156 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 436/874] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:46 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:47.326663 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-e80fe98f-fcc5-4543-90b0-8b1e782dae12 req-1eb8889a-27dc-40a3-b1fa-4b762f07e3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b", "name": "network-vif-plugged", "status": "completed", "tag": "daed8555-b3cf-4de0-a0ee-64e47eda395e"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:47.330878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:47.333054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=8 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:47.337393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-e80fe98f-fcc5-4543-90b0-8b1e782dae12 req-1eb8889a-27dc-40a3-b1fa-4b762f07e3ef service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:47.337832 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-e80fe98f-fcc5-4543-90b0-8b1e782dae12 req-1eb8889a-27dc-40a3-b1fa-4b762f07e3ef service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:47.349170 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-e80fe98f-fcc5-4543-90b0-8b1e782dae12 req-1eb8889a-27dc-40a3-b1fa-4b762f07e3ef service nova] Creating event network-vif-plugged:daed8555-b3cf-4de0-a0ee-64e47eda395e for instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b on hv-cinder-78729 Jun 22 09:08:47.354732 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-e80fe98f-fcc5-4543-90b0-8b1e782dae12 req-1eb8889a-27dc-40a3-b1fa-4b762f07e3ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031760 Jun 22 09:08:47.355343 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 439/875] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:47.410604 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:47.411636 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:47.419329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:47.419765 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:47.421093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:47.421093 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:47.589689 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:47.598279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b5efbf61-2437-410f-9c31-899cb2930874 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.193155 Jun 22 09:08:47.598856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 437/876] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:47 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:08:48.617868 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:48.619254 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:48.627479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:48.627939 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:48.630089 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:48.630089 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:48.810394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:48.818345 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-17a2f2d6-2bbb-4856-b91d-55738fccc5ba tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1318 microversion: 2.1 time: 0.206149 Jun 22 09:08:48.819135 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 440/877] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:48 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:49.836282 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:49.836888 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:49.839371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:49.844775 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:49.845217 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:49.845984 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:49.846499 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:49.850890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:50.019042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:50.026831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-00807a55-78a0-4bd7-a754-ec2e7da06a1b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1506 microversion: 2.1 time: 0.194380 Jun 22 09:08:50.027400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 438/878] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:49 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:53.339408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1981344702", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:53.387191 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] validate_networks() for None {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:08:53.688586 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:08:53.689002 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:08:53.689471 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:08:53.690048 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:08:53.691222 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:08:53.700543 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:53.701007 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:53.701827 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:53.702380 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:53.721293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Getting quotas for project 19f6894eab29429a9c6829381a675e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:08:53.726203 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Getting quotas for user 2726a3c19e70480fb92a1fbc6a483806 and project 19f6894eab29429a9c6829381a675e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:08:53.739025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:08:53.741416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:08:53.862914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-877bf651-387a-482d-aff9-3029339ea27d tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527198 Jun 22 09:08:53.868046 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 441/879] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:08:53.873903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fde45ad9-d360-40bb-b856-42cda27786ee tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:53.874530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fde45ad9-d360-40bb-b856-42cda27786ee tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:53.933691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fde45ad9-d360-40bb-b856-42cda27786ee tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:53.941080 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fde45ad9-d360-40bb-b856-42cda27786ee tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1215 microversion: 2.1 time: 0.071342 Jun 22 09:08:53.942122 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 439/880] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:53 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:54.959003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:54.959611 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:54.968567 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:54.969019 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:54.969779 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:54.970248 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:55.031575 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:55.041042 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b7074c95-cc47-4e53-bc9d-585fe52052ac tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1219 microversion: 2.1 time: 0.086712 Jun 22 09:08:55.041725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 442/881] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:54 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:56.057922 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:56.058548 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:56.064995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:56.065584 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:56.066361 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:56.066865 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:56.130053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:56.137624 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-db4716ec-b92f-4425-a5f6-58aea99fb44c tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1267 microversion: 2.1 time: 0.083560 Jun 22 09:08:56.138212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 440/882] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:56 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:57.156021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:57.156552 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:57.164051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.164506 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:57.165357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:57.165798 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:57.375274 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:57.383965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f0a27d6b-8214-4926-80d9-e6526df33e96 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.231865 Jun 22 09:08:57.384549 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 443/883] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:57 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:58.261265 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-acf0f98b-f44d-427c-a20e-7db81eb7d5ba req-a4cb80c2-5f81-4c8f-8092-e0d3e8f83d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ef12ac-4066-450d-91fb-31fe735bdea7", "tag": "2128ce76-0f3f-4f96-9a0e-8015eb061c11"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:08:58.270493 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-acf0f98b-f44d-427c-a20e-7db81eb7d5ba req-a4cb80c2-5f81-4c8f-8092-e0d3e8f83d76 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:58.275273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-acf0f98b-f44d-427c-a20e-7db81eb7d5ba req-a4cb80c2-5f81-4c8f-8092-e0d3e8f83d76 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.282221 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-acf0f98b-f44d-427c-a20e-7db81eb7d5ba req-a4cb80c2-5f81-4c8f-8092-e0d3e8f83d76 service nova] Creating event network-changed:2128ce76-0f3f-4f96-9a0e-8015eb061c11 for instance d0ef12ac-4066-450d-91fb-31fe735bdea7 on hv-cinder-78729 Jun 22 09:08:58.287964 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-acf0f98b-f44d-427c-a20e-7db81eb7d5ba req-a4cb80c2-5f81-4c8f-8092-e0d3e8f83d76 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030517 Jun 22 09:08:58.288735 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 441/884] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:08:58.400735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:58.402037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:58.409247 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:58.409699 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.410508 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:58.410937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:58.593221 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:58.601045 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8a252452-5943-4a5e-87bb-36dcdac25b02 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.204078 Jun 22 09:08:58.601704 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 444/885] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:58 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:08:59.620006 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:08:59.620706 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:08:59.627058 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:59.627590 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:59.628497 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:08:59.628989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:08:59.771473 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:08:59.773744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ae4b879c-ce6c-4f85-8bcb-6cf07d6aec95 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.158769 Jun 22 09:08:59.774350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 442/886] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:08:59 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:00.790627 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:00.791259 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:00.797750 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:00.798364 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:00.799619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:00.800068 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:00.934880 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:00.943374 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bb725ee2-d390-45d1-855d-0ae4a0c7d807 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.156609 Jun 22 09:09:00.943939 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 445/887] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:00 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:01.961825 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:01.962378 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:01.968915 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:01.969343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:01.970135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:01.970639 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:02.100722 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:02.108416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9d60be71-72f0-4b06-bb15-d4f64eb4b797 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.150899 Jun 22 09:09:02.108977 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 443/888] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:01 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:03.126609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:03.127825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:03.133917 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:03.134404 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:03.135169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:03.135605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:03.269892 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:03.279005 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5615ccb5-cebc-4903-a330-02bf81988388 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.156529 Jun 22 09:09:03.279583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 446/889] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:03 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:03.393129 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-6e7c10df-c155-4c21-8e3a-3cee2d4810a2 req-bd38aaf5-aa37-472e-8968-6df81fdbc032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ef12ac-4066-450d-91fb-31fe735bdea7", "name": "network-vif-plugged", "status": "completed", "tag": "2128ce76-0f3f-4f96-9a0e-8015eb061c11"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:03.401701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-6e7c10df-c155-4c21-8e3a-3cee2d4810a2 req-bd38aaf5-aa37-472e-8968-6df81fdbc032 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:03.402169 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-6e7c10df-c155-4c21-8e3a-3cee2d4810a2 req-bd38aaf5-aa37-472e-8968-6df81fdbc032 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:03.413418 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-6e7c10df-c155-4c21-8e3a-3cee2d4810a2 req-bd38aaf5-aa37-472e-8968-6df81fdbc032 service nova] Creating event network-vif-plugged:2128ce76-0f3f-4f96-9a0e-8015eb061c11 for instance d0ef12ac-4066-450d-91fb-31fe735bdea7 on hv-cinder-78729 Jun 22 09:09:03.418378 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-6e7c10df-c155-4c21-8e3a-3cee2d4810a2 req-bd38aaf5-aa37-472e-8968-6df81fdbc032 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029007 Jun 22 09:09:03.422579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 444/890] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:04.297110 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:04.297729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:04.300420 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:04.301223 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=6 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:04.307468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:04.307915 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:04.308686 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:04.309121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:04.446650 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:04.454237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e59d2e7d-7830-45ef-a65f-65f663b132dd tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.160974 Jun 22 09:09:04.454893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 447/891] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:04 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:05.468190 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:05.472970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:05.473659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:05.480319 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:05.480763 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:05.481512 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:05.484040 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:05.622163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:05.630329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-34d5657b-eab1-4827-8249-66f33a0a27c6 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1315 microversion: 2.1 time: 0.163172 Jun 22 09:09:05.630824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 445/892] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:05 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:06.653031 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:06.653641 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:06.655966 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:06.661073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:06.661517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:06.662315 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:06.662817 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:06.795671 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:06.804018 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-068b07b4-39c0-4a50-ac94-eeee2e723e08 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1464 microversion: 2.1 time: 0.154922 Jun 22 09:09:06.804578 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 448/893] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:06 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:06.844321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:06.844817 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:06.847394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=42 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:06.852342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:06.853032 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:06.853785 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:06.854246 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:06.881044 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:09:07.365328 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0deca8f1-c314-40b4-8dcf-c82c175e0036 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 204 len: 0 microversion: 2.1 time: 0.524553 Jun 22 09:09:07.365922 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 446/894] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:09:06 2022] DELETE /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:09:07.374274 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:07.380054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:07.381207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:07.381659 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:07.382443 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:07.382877 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:07.521148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:07.526836 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6d448742-4b74-427d-a707-e7e4e7285004 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1470 microversion: 2.1 time: 0.156555 Jun 22 09:09:07.527437 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 449/895] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:07 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:07.528783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1b17dc2f-7e5d-4661-a0e9-64f2175aac08 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce864c0-5f46-409b-a84e-6c3b91bc5d0b", "device": "/dev/sdb"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:07.530506 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1b17dc2f-7e5d-4661-a0e9-64f2175aac08 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:07.538917 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b17dc2f-7e5d-4661-a0e9-64f2175aac08 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:07.539368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b17dc2f-7e5d-4661-a0e9-64f2175aac08 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:07.540168 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b17dc2f-7e5d-4661-a0e9-64f2175aac08 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:07.540602 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1b17dc2f-7e5d-4661-a0e9-64f2175aac08 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:08.544811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:08.545389 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:08.552355 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:08.552802 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:08.553564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:08.553998 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:08.692059 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:08.699921 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-09c5ff66-3439-45a8-8e57-1b77909e4e88 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1470 microversion: 2.1 time: 0.158929 Jun 22 09:09:08.701001 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 450/896] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:08 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:09.360039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1b17dc2f-7e5d-4661-a0e9-64f2175aac08 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "POST /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.835619 Jun 22 09:09:09.362157 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 447/897] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:09:07 2022] POST /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b/os-volume_attachments => generated 194 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:09:09.449898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-ea50c203-174b-4f78-80e8-f24d2df4c3b7 req-6aa24771-ba0c-42a1-aed8-63e6a1d3ed37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ef12ac-4066-450d-91fb-31fe735bdea7", "name": "network-vif-deleted", "tag": "2128ce76-0f3f-4f96-9a0e-8015eb061c11"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:09.463725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-ea50c203-174b-4f78-80e8-f24d2df4c3b7 req-6aa24771-ba0c-42a1-aed8-63e6a1d3ed37 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:09.463725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-ea50c203-174b-4f78-80e8-f24d2df4c3b7 req-6aa24771-ba0c-42a1-aed8-63e6a1d3ed37 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:09.471740 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-ea50c203-174b-4f78-80e8-f24d2df4c3b7 req-6aa24771-ba0c-42a1-aed8-63e6a1d3ed37 service nova] Creating event network-vif-deleted:2128ce76-0f3f-4f96-9a0e-8015eb061c11 for instance d0ef12ac-4066-450d-91fb-31fe735bdea7 on hv-cinder-78729 Jun 22 09:09:09.477772 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-ea50c203-174b-4f78-80e8-f24d2df4c3b7 req-6aa24771-ba0c-42a1-aed8-63e6a1d3ed37 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031818 Jun 22 09:09:09.478601 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 451/898] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:09.718577 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:09.719182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:09.726545 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:09.726997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:09.728015 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:09.728467 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:09.792725 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2726a3c19e70480fb92a1fbc6a483806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6894eab29429a9c6829381a675e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:09.800335 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1abcc6b4-38cd-48d2-899e-663e7da3e27f tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 200 len: 1300 microversion: 2.1 time: 0.086123 Jun 22 09:09:09.800890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 448/899] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:09 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:10.818743 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:10.819444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] [instance: d0ef12ac-4066-450d-91fb-31fe735bdea7] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:10.825650 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:10.826121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:10.826887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:10.827321 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:10.841532 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] HTTP exception thrown: Instance d0ef12ac-4066-450d-91fb-31fe735bdea7 could not be found. Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Request method failure captured: Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 HTTP/1.1 Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistwjm9MwcCgdECFSvzdEcCsG_Okhqi4jY4OFIzCcvdP8HS3Ql2qNxntvIWxStVO4isheV4XJyrcPa_oj-4R7vG70m8-LL3cw8P4XM00LxWVIMlVzmoExj8RVbR5pX3OZIGSJSviSVsmzfFtJKE2Fu8Twv-b3CdqA3c8WjzC7hOR5W8g Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 19f6894eab29429a9c6829381a675e5f Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesNegativeTest-1541667547 Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:09:10.843226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19f6894eab29429a9c6829381a675e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19f6894eab29429a9c6829381a675e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19f6894eab29429a9c6829381a675e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19f6894eab29429a9c6829381a675e5f"}]}] Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesNegativeTest-1541667547 Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 19f6894eab29429a9c6829381a675e5f Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesNegativeTest-1541667547 Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesNegativeTest-1541667547-project Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 2726a3c19e70480fb92a1fbc6a483806 Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesNegativeTest-1541667547-project Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance d0ef12ac-4066-450d-91fb-31fe735bdea7 could not be found. Jun 22 09:09:10.844841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'd0ef12ac-4066-450d-91fb-31fe735bdea7'} Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ef12ac-4066-450d-91fb-31fe735bdea7 could not be found. Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:10.846377 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ef12ac-4066-450d-91fb-31fe735bdea7 could not be found. Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ef12ac-4066-450d-91fb-31fe735bdea7 could not be found. Jun 22 09:09:10.847735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:10.848879 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] Returning 404 to user: Instance d0ef12ac-4066-450d-91fb-31fe735bdea7 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:10.848879 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4293c985-014a-458f-8df6-ce0d8b7d7927 tempest-VolumesNegativeTest-1541667547 tempest-VolumesNegativeTest-1541667547-project] 10.222.0.36 "GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7" status: 404 len: 111 microversion: 2.1 time: 0.030939 Jun 22 09:09:10.849462 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 452/900] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:10 2022] GET /compute/v2.1/servers/d0ef12ac-4066-450d-91fb-31fe735bdea7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:09:15.030303 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dcef2949-2d7b-4007-bc3c-f451278d31f1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:15.031226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dcef2949-2d7b-4007-bc3c-f451278d31f1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:15.041118 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dcef2949-2d7b-4007-bc3c-f451278d31f1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.041907 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dcef2949-2d7b-4007-bc3c-f451278d31f1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.042903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dcef2949-2d7b-4007-bc3c-f451278d31f1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.043343 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dcef2949-2d7b-4007-bc3c-f451278d31f1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.073127 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dcef2949-2d7b-4007-bc3c-f451278d31f1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046825 Jun 22 09:09:15.073795 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 449/901] 10.222.0.36 () {60 vars in 1342 bytes} [Wed Jun 22 09:09:15 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:15.137547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:15.138108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:15.145256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.145707 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.146505 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.146940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.149837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=92 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:15.175927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:09:15.450485 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-37fb4abf-aeb2-4e59-965c-f581fc441e23 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 204 len: 0 microversion: 2.20 time: 0.316414 Jun 22 09:09:15.450983 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 453/902] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 09:09:15 2022] DELETE /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:09:15.461356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:15.461356 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:15.467358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.467796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.468554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:15.468980 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:15.620629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:15.629983 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:15.632222 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:15.633015 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f4f62dac-b589-4e69-86c5-2800ed357841 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.176471 Jun 22 09:09:15.633234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 450/903] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:15 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:09:16.652842 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:16.653584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:16.661414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:16.661873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:16.662773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:16.663246 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:16.799057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:16.808026 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:16.809522 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:16.810729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c9a78278-da24-4b87-96df-e61ab556e0c2 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.162617 Jun 22 09:09:16.811452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 454/904] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:16 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:09:17.829628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:17.830533 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:17.847197 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.847645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:17.848422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:17.848856 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:18.028639 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:18.037648 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:18.039200 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:18.040346 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1e1320b0-9446-4539-ad84-14653a585219 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1723 microversion: 2.20 time: 0.214783 Jun 22 09:09:18.040897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 451/905] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:17 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:09:18.575234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-01a262b6-845b-4f05-a551-334445c9c745 req-285b5de7-804c-40cb-b2e7-d59c3f589606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1ef288-3b6e-4369-8492-76898b858067", "name": "network-vif-deleted", "tag": "f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:18.584175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-01a262b6-845b-4f05-a551-334445c9c745 req-285b5de7-804c-40cb-b2e7-d59c3f589606 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:18.584855 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-01a262b6-845b-4f05-a551-334445c9c745 req-285b5de7-804c-40cb-b2e7-d59c3f589606 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:18.597025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-01a262b6-845b-4f05-a551-334445c9c745 req-285b5de7-804c-40cb-b2e7-d59c3f589606 service nova] Creating event network-vif-deleted:f9c7f6a1-3101-4cb8-aa47-5aeefb31d27f for instance ea1ef288-3b6e-4369-8492-76898b858067 on hv-cinder-78729 Jun 22 09:09:18.602008 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-01a262b6-845b-4f05-a551-334445c9c745 req-285b5de7-804c-40cb-b2e7-d59c3f589606 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030671 Jun 22 09:09:18.606032 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 455/906] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:19.059564 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:19.060180 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:19.067853 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.068310 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.069199 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.069629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.101394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:19.101874 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:19.102603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lazy-loading 'fault' on Instance uuid ea1ef288-3b6e-4369-8492-76898b858067 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:09:19.143572 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:19.152269 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:19.153767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:19.154968 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-85bf257d-830c-4c3a-8001-1048be652d32 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1370 microversion: 2.20 time: 0.099582 Jun 22 09:09:19.155528 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 452/907] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:19 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:09:20.180461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:20.181086 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:20.187547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:20.188001 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:20.188763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:20.189203 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:20.224431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:20.224883 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:20.225336 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lazy-loading 'fault' on Instance uuid ea1ef288-3b6e-4369-8492-76898b858067 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:09:20.272295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:20.280270 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:20.281747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:20.283757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-dfb0227e-39c0-4b98-87eb-9af8e60acf2f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1370 microversion: 2.20 time: 0.107379 Jun 22 09:09:20.284106 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 456/908] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:20 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:09:21.302708 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:21.303311 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:21.309767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.310260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.311015 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.311444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.341234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:21.341680 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:21.343790 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lazy-loading 'fault' on Instance uuid ea1ef288-3b6e-4369-8492-76898b858067 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:09:21.343972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:21.385531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:21.393824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:21.395334 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd07859f7aba4b908b2779af70a5f5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec813daa61ab4ac59a2197042fb35325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:21.396462 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-de15ecb7-fcd1-46db-a0fd-f11ffe99c611 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 200 len: 1370 microversion: 2.20 time: 0.098512 Jun 22 09:09:21.397028 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 453/909] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:21 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 09:09:22.415384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:22.415955 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:22.422572 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.423072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.424370 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:22.424800 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:22.438559 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] HTTP exception thrown: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Request method failure captured: Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 HTTP/1.1 Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistqYYF0c54erDHMySiM1QET859niMVk4X_a-gGRrfxEw-TKllmfEP32Qy_oIVetbc-FYULaAiDhHIZG_zukfmr86s80fgqZ7cFu4sIoZ75cvfSUmwIvnYszAtPKzpmrMuItpL6sX4C-LerqlHOnfIK1Z-X8Clg7JP3VvnqU8fQnVdgM Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:09:22.440887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}] Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: dd07859f7aba4b908b2779af70a5f5e1 Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:22.442565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'ea1ef288-3b6e-4369-8492-76898b858067'} Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:22.443359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:22.444574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:22.445657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Returning 404 to user: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:22.445657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-85573d02-65d9-4f9f-a96c-5eac49b6c3bc tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 404 len: 111 microversion: 2.20 time: 0.030918 Jun 22 09:09:22.445657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 457/910] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:22 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:09:22.452311 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c81097fb-fce3-4db6-9965-1cca1272f69f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '.version_select at 0x7fb331e2aa60>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:22.540558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c81097fb-fce3-4db6-9965-1cca1272f69f tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-277595967" status: 204 len: 0 microversion: 2.20 time: 0.093099 Jun 22 09:09:22.541175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 454/911] 10.222.0.36 () {60 vars in 1258 bytes} [Wed Jun 22 09:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-277595967 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 09:09:26.651742 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:26.652226 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:26.658842 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:26.659280 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:26.660024 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:26.660452 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:26.673861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] HTTP exception thrown: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Request method failure captured: Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 HTTP/1.1 Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistqYYF0c54erDHMySiM1QET859niMVk4X_a-gGRrfxEw-TKllmfEP32Qy_oIVetbc-FYULaAiDhHIZG_zukfmr86s80fgqZ7cFu4sIoZ75cvfSUmwIvnYszAtPKzpmrMuItpL6sX4C-LerqlHOnfIK1Z-X8Clg7JP3VvnqU8fQnVdgM Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:09:26.675445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}] Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: dd07859f7aba4b908b2779af70a5f5e1 Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.677088 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'ea1ef288-3b6e-4369-8492-76898b858067'} Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:26.677923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.679441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.680972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Returning 404 to user: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:26.680972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e73a10b4-0cae-4025-b87a-03ce181b5803 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 404 len: 111 microversion: 2.20 time: 0.028882 Jun 22 09:09:26.680972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 458/912] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 09:09:26 2022] DELETE /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:09:26.686210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:26.686814 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: ea1ef288-3b6e-4369-8492-76898b858067] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:26.694143 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:26.694784 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:26.695530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:26.695957 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:26.709518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] HTTP exception thrown: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Request method failure captured: Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 HTTP/1.1 Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistqYYF0c54erDHMySiM1QET859niMVk4X_a-gGRrfxEw-TKllmfEP32Qy_oIVetbc-FYULaAiDhHIZG_zukfmr86s80fgqZ7cFu4sIoZ75cvfSUmwIvnYszAtPKzpmrMuItpL6sX4C-LerqlHOnfIK1Z-X8Clg7JP3VvnqU8fQnVdgM Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:09:26.711202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}] Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: dd07859f7aba4b908b2779af70a5f5e1 Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.712882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'ea1ef288-3b6e-4369-8492-76898b858067'} Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:26.713628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. Jun 22 09:09:26.714877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:26.715960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Returning 404 to user: Instance ea1ef288-3b6e-4369-8492-76898b858067 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:26.715960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-bbcc2538-f40b-4d03-a6de-ec76c98fb992 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067" status: 404 len: 111 microversion: 2.20 time: 0.031206 Jun 22 09:09:26.715960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 455/913] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:26 2022] GET /compute/v2.1/servers/ea1ef288-3b6e-4369-8492-76898b858067 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 09:09:27.982138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:27.982615 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:27.989611 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:27.990070 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:27.990837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:27.991268 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.005378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] HTTP exception thrown: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Request method failure captured: Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 HTTP/1.1 Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistqYYF0c54erDHMySiM1QET859niMVk4X_a-gGRrfxEw-TKllmfEP32Qy_oIVetbc-FYULaAiDhHIZG_zukfmr86s80fgqZ7cFu4sIoZ75cvfSUmwIvnYszAtPKzpmrMuItpL6sX4C-LerqlHOnfIK1Z-X8Clg7JP3VvnqU8fQnVdgM Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:09:28.006960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}] Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: dd07859f7aba4b908b2779af70a5f5e1 Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.008554 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '570dea14-f80c-45cc-9935-7cf6d445d337'} Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:28.009517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.011039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.012564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Returning 404 to user: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:28.012564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b8169229-66b6-42df-833f-d66e4cef1c27 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "DELETE /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 404 len: 111 microversion: 2.20 time: 0.030080 Jun 22 09:09:28.012564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 459/914] 10.222.0.36 () {60 vars in 1279 bytes} [Wed Jun 22 09:09:27 2022] DELETE /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:09:28.016744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:28.017505 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] [instance: 570dea14-f80c-45cc-9935-7cf6d445d337] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:28.023952 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.024391 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.025134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:28.025560 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:28.039160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] HTTP exception thrown: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Request method failure captured: Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 HTTP/1.1 Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistqYYF0c54erDHMySiM1QET859niMVk4X_a-gGRrfxEw-TKllmfEP32Qy_oIVetbc-FYULaAiDhHIZG_zukfmr86s80fgqZ7cFu4sIoZ75cvfSUmwIvnYszAtPKzpmrMuItpL6sX4C-LerqlHOnfIK1Z-X8Clg7JP3VvnqU8fQnVdgM Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:09:28.040657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ec813daa61ab4ac59a2197042fb35325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ec813daa61ab4ac59a2197042fb35325"}]}] Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: ec813daa61ab4ac59a2197042fb35325 Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1501273356 Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: dd07859f7aba4b908b2779af70a5f5e1 Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1501273356-project Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.042371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '570dea14-f80c-45cc-9935-7cf6d445d337'} Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:28.043238 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. Jun 22 09:09:28.044641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:28.045916 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] Returning 404 to user: Instance 570dea14-f80c-45cc-9935-7cf6d445d337 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:28.045916 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-53136afa-0276-4f37-84aa-e11e84cd96a1 tempest-AttachVolumeShelveTestJSON-1501273356 tempest-AttachVolumeShelveTestJSON-1501273356-project] 10.222.0.36 "GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337" status: 404 len: 111 microversion: 2.20 time: 0.029035 Jun 22 09:09:28.045916 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 456/915] 10.222.0.36 () {60 vars in 1276 bytes} [Wed Jun 22 09:09:28 2022] GET /compute/v2.1/servers/570dea14-f80c-45cc-9935-7cf6d445d337 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 09:09:35.258749 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:35.259974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:35.266403 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.267782 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.269441 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:35.270308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:35.365003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lazy-loading 'services' on Instance uuid ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:09:35.583302 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0043d376-595c-4ca9-9a4d-a42913936c76 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b/os-volume_attachments/3ce864c0-5f46-409b-a84e-6c3b91bc5d0b" status: 202 len: 0 microversion: 2.1 time: 0.328968 Jun 22 09:09:35.584313 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 460/916] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:09:35 2022] DELETE /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b/os-volume_attachments/3ce864c0-5f46-409b-a84e-6c3b91bc5d0b => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:09:37.789917 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:37.790529 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:37.793253 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:37.803704 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.804464 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:37.806216 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:37.806718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:37.842645 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:09:38.321985 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4b11bd64-f338-4150-bd54-c04f94ccf727 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 204 len: 0 microversion: 2.1 time: 0.535654 Jun 22 09:09:38.322646 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 457/917] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:09:37 2022] DELETE /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:09:38.336526 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:38.337783 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:38.342252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:38.352434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:38.353244 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:38.354611 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:38.355954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:38.598082 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:38.607528 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-21d42908-b66e-4de9-a910-f32f36296a17 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1512 microversion: 2.1 time: 0.279437 Jun 22 09:09:38.610274 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 461/918] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:38 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:39.443465 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d50a5519-b4f3-49b6-a5f0-0185b2d6f617 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'create', calling method: .version_select at 0x7fb331e2ab80>, body: {"keypair": {"name": "tempest-keypair-800785142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLoeKCi7zv+2PM0Uwdg3lBk473I5/NHNkI/LenTetocOhgzPSqE5AFcPnQz3O626b2FKThkNfGuTKm6d7ImQ8IzKZklbqaNzsWled2q6rpO9/j99Z9VukmdOUcJLucIkg=="}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:39.458191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-d50a5519-b4f3-49b6-a5f0-0185b2d6f617 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for project 39db61e788d04620a94bb0ddea0cd726. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:39.462280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-d50a5519-b4f3-49b6-a5f0-0185b2d6f617 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for user 322de5283c4e40ebb3911456f96812cb and project 39db61e788d04620a94bb0ddea0cd726. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:39.587599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d50a5519-b4f3-49b6-a5f0-0185b2d6f617 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.270575 Jun 22 09:09:39.588195 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 458/919] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:09:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:39.625647 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:39.631689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:39.633902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.634378 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.635154 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:39.635594 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:39.821419 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:39.830779 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1b3fd8be-4a1f-4341-9979-291aa13f1c36 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1512 microversion: 2.1 time: 0.209449 Jun 22 09:09:39.831339 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 462/920] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:39 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:40.513970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-0f6bab28-9561-4187-89dc-05fff1f33488 req-fd751b72-d716-4bdd-a3f2-f17ccc46410a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b", "name": "network-vif-deleted", "tag": "daed8555-b3cf-4de0-a0ee-64e47eda395e"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:40.523167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0f6bab28-9561-4187-89dc-05fff1f33488 req-fd751b72-d716-4bdd-a3f2-f17ccc46410a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.523613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0f6bab28-9561-4187-89dc-05fff1f33488 req-fd751b72-d716-4bdd-a3f2-f17ccc46410a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.534756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-0f6bab28-9561-4187-89dc-05fff1f33488 req-fd751b72-d716-4bdd-a3f2-f17ccc46410a service nova] Creating event network-vif-deleted:daed8555-b3cf-4de0-a0ee-64e47eda395e for instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b on hv-cinder-78729 Jun 22 09:09:40.539943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-0f6bab28-9561-4187-89dc-05fff1f33488 req-fd751b72-d716-4bdd-a3f2-f17ccc46410a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029782 Jun 22 09:09:40.540810 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 459/921] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:40.850842 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:40.853747 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:40.863160 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.863628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.864433 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.864861 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.916119 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:40.916639 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:40.917367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lazy-loading 'fault' on Instance uuid ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:09:40.970425 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:40.977476 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-092c8e50-c94d-4a70-a4b8-129219c24649 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 200 len: 1308 microversion: 2.1 time: 0.132562 Jun 22 09:09:40.978130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 463/922] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:40 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:41.997382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:41.998124 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:42.005176 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.005616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.006416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:42.006845 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:42.023592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] HTTP exception thrown: Instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b could not be found. Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Request method failure captured: Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b HTTP/1.1 Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistwQzFXBnz_QAJ2vTMAt0_vx3qAFeCxv2jNMI6erQrGWV6tQLYuW9Rl6Sr7TNetolxqAAtU9c96Lftln19P2FK1DY_QIZPoC1sDoBNN-s8m3jjrpqZ5cdc4OUTV9N2GbKS2o4NTqo1KKQL10dRSDP0p9j3x0F6J4xbiNTp3nP1oi08Q Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: d2c631e8f3d544309a09e7bf6e39f780 Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1760635210 Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:09:42.025260 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d2c631e8f3d544309a09e7bf6e39f780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d2c631e8f3d544309a09e7bf6e39f780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d2c631e8f3d544309a09e7bf6e39f780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d2c631e8f3d544309a09e7bf6e39f780"}]}] Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-VolumesSnapshotTestJSON-1760635210 Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: d2c631e8f3d544309a09e7bf6e39f780 Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1760635210 Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-VolumesSnapshotTestJSON-1760635210-project Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 6b9e8a4e5a51463c826c821375c1d28c Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-VolumesSnapshotTestJSON-1760635210-project Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b could not be found. Jun 22 09:09:42.026963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b'} Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b could not be found. Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:09:42.027884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b could not be found. Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b could not be found. Jun 22 09:09:42.029438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:09:42.030809 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Returning 404 to user: Instance ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:09:42.030809 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7abfc099-85a9-4f2c-bec0-ce99a71e903b tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b" status: 404 len: 111 microversion: 2.1 time: 0.034586 Jun 22 09:09:42.030809 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 460/923] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:41 2022] GET /compute/v2.1/servers/ff94ee8f-89c0-4cb4-82de-2bb1a1210a7b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:09:42.616476 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-365136594", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b046ebff-06e8-420c-9d94-82044ffbff87"}], "security_groups": [{"name": "tempest-securitygroup--1238141310"}], "key_name": "tempest-keypair-800785142", "user_data": "}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:42.787959 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] validate_networks() for [('b046ebff-06e8-420c-9d94-82044ffbff87', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:09:43.232103 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:09:43.232676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:09:43.233158 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:09:43.233571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:09:43.234034 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:09:43.243853 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:43.257729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:43.257729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:43.257729 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:43.263887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for project 39db61e788d04620a94bb0ddea0cd726. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:43.268814 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for user 322de5283c4e40ebb3911456f96812cb and project 39db61e788d04620a94bb0ddea0cd726. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:43.280177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:09:43.282609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:09:43.419400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c71a3506-23f7-4d8b-b96f-8322e79c7979 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.812755 Jun 22 09:09:43.424615 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 464/924] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:09:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:09:43.430456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-150e6cd1-8d07-4541-82f7-dd75fbc8deec tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:43.431718 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-150e6cd1-8d07-4541-82f7-dd75fbc8deec tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:43.494593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-150e6cd1-8d07-4541-82f7-dd75fbc8deec tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:43.501782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-150e6cd1-8d07-4541-82f7-dd75fbc8deec tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1236 microversion: 2.1 time: 0.075336 Jun 22 09:09:43.502370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 461/925] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:43 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:44.519913 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:44.520520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:44.527210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.527655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.528407 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:44.528837 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:44.594935 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:44.607899 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b6ab41f3-b33c-45d8-815a-fc5faa0cd2f2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1240 microversion: 2.1 time: 0.091933 Jun 22 09:09:44.608959 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 465/926] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:44 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:45.629391 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:45.630027 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:45.637858 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.638341 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.639135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:45.639571 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:45.708626 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:45.716403 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8dbbeb41-54c4-4fd5-94e6-bd5704b94775 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1232 microversion: 2.1 time: 0.091533 Jun 22 09:09:45.716957 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 462/927] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:45 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1232 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:46.734280 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:46.734898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:46.741940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:46.742432 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:46.743211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:46.743648 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:46.748588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:46.826130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:46.835864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f091f81d-355a-4b81-ac8c-5c2916c0fddf tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1294 microversion: 2.1 time: 0.105418 Jun 22 09:09:46.836435 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 466/928] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:46 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:47.857469 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:47.861440 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:47.868659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:47.869179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:47.870046 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:47.870571 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:48.051333 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:48.058779 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-74460c8f-0ae2-4355-a629-f91baf32750d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.209289 Jun 22 09:09:48.059358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 463/929] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:47 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:48.136462 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-20de2cbe-4407-4ef3-bb7d-2daf85a3e8a4 req-37217ae0-7acd-4245-920e-42c857fd8a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd2ba2e-895b-47db-a4c2-fdd8d75dc726", "tag": "b581409a-f9b3-40d0-bace-957da69bd0eb"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:48.147055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-20de2cbe-4407-4ef3-bb7d-2daf85a3e8a4 req-37217ae0-7acd-4245-920e-42c857fd8a34 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:48.147502 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-20de2cbe-4407-4ef3-bb7d-2daf85a3e8a4 req-37217ae0-7acd-4245-920e-42c857fd8a34 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:48.160639 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-20de2cbe-4407-4ef3-bb7d-2daf85a3e8a4 req-37217ae0-7acd-4245-920e-42c857fd8a34 service nova] Creating event network-changed:b581409a-f9b3-40d0-bace-957da69bd0eb for instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 on hv-cinder-78729 Jun 22 09:09:48.167384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-20de2cbe-4407-4ef3-bb7d-2daf85a3e8a4 req-37217ae0-7acd-4245-920e-42c857fd8a34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036298 Jun 22 09:09:48.168017 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 467/930] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:49.076405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:49.076994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:49.083551 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:49.083993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:49.084744 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:49.085175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:49.216247 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:49.224225 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-dd1ae018-364a-484c-ad2e-392b74694d56 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.151655 Jun 22 09:09:49.224775 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 464/931] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:49 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:50.242507 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:50.243237 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:50.249551 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:50.249893 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:50.250689 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:50.251121 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:50.463488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:50.480645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f9f24099-14dd-48c7-8afc-6a74248addb8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.242845 Jun 22 09:09:50.480645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 468/932] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:50 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:50.568680 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-169825404", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "networks": [{"uuid": "1fc6598b-8630-43a0-8fc7-8a555dfcd6af"}]}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:50.626461 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] validate_networks() for [('1fc6598b-8630-43a0-8fc7-8a555dfcd6af', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:09:51.232381 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:09:51.232901 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:09:51.233377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:09:51.233787 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:09:51.234227 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:09:51.243391 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.243834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.244634 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.245071 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.262367 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Getting quotas for project d2c631e8f3d544309a09e7bf6e39f780. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:09:51.266345 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Getting quotas for user 6b9e8a4e5a51463c826c821375c1d28c and project d2c631e8f3d544309a09e7bf6e39f780. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:09:51.277680 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:09:51.279972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:09:51.417101 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-abba900b-a586-40a9-87e6-0446b1d830af tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852285 Jun 22 09:09:51.417685 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 465/933] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:09:51.428340 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-fd90fe2e-7c71-4795-af49-d0f26b4c4878 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:51.428945 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-fd90fe2e-7c71-4795-af49-d0f26b4c4878 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:51.488900 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-fd90fe2e-7c71-4795-af49-d0f26b4c4878 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:51.496310 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-fd90fe2e-7c71-4795-af49-d0f26b4c4878 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1218 microversion: 2.1 time: 0.072515 Jun 22 09:09:51.497134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 469/934] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:51 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:51.501632 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:51.503454 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:51.513218 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.513736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.514746 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:51.515340 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:51.650233 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:51.657672 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-7207d5a4-a2bd-428d-b625-6b7afddf0c28 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.163319 Jun 22 09:09:51.658301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 466/935] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:51 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:52.514383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:52.515070 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:52.523988 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:52.524604 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:52.526037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:52.526542 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:52.590103 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:52.598104 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-78a72a42-4619-4bce-8d1d-abffb931f69a tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1222 microversion: 2.1 time: 0.087497 Jun 22 09:09:52.598548 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 470/936] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:52 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:52.683013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:52.683629 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:52.691078 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:52.691992 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:52.693146 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:52.693722 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:52.830362 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:52.837990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cfe233a6-1362-4435-8105-4044df28ef12 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.159075 Jun 22 09:09:52.838582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 467/937] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:52 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:53.616114 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:53.617189 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:53.618777 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:53.624470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:53.624923 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:53.625708 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:53.626170 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:53.708350 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:53.719219 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a34ba3aa-a0a7-4fb4-b3c7-548191c1a271 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1288 microversion: 2.1 time: 0.107063 Jun 22 09:09:53.721014 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 471/938] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:53 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:53.856143 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:53.856768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:53.866787 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:53.867956 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:53.868822 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:53.870484 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.111946 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:54.120642 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-781810a7-aed4-42a5-8236-44a2d0a75002 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.269355 Jun 22 09:09:54.121284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 468/939] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:53 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:54.740813 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:54.741574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:54.748413 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.748868 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.749642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:54.750116 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:54.923616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:54.931661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5aec4906-de06-408d-823c-0402a946f7e3 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.195200 Jun 22 09:09:54.932540 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 472/940] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:54 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:55.138795 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:55.139395 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:55.146547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.146997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:55.147757 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.148422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:55.263512 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-b16fa8c1-b4b6-4c99-bd49-dccec31d30c4 req-d9b58e18-6530-4a18-95d9-ead689ea019a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512bad88-21fe-437e-8a85-f71503963183", "tag": "96d217d4-7f7e-4b48-9765-4d629d4b6509"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:55.273205 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-b16fa8c1-b4b6-4c99-bd49-dccec31d30c4 req-d9b58e18-6530-4a18-95d9-ead689ea019a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.273205 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-b16fa8c1-b4b6-4c99-bd49-dccec31d30c4 req-d9b58e18-6530-4a18-95d9-ead689ea019a service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:55.283525 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-b16fa8c1-b4b6-4c99-bd49-dccec31d30c4 req-d9b58e18-6530-4a18-95d9-ead689ea019a service nova] Creating event network-changed:96d217d4-7f7e-4b48-9765-4d629d4b6509 for instance 512bad88-21fe-437e-8a85-f71503963183 on hv-cinder-78729 Jun 22 09:09:55.289793 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-b16fa8c1-b4b6-4c99-bd49-dccec31d30c4 req-d9b58e18-6530-4a18-95d9-ead689ea019a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029623 Jun 22 09:09:55.290609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 473/941] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:55.645907 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:55.654117 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3cf9575d-0c61-4a5c-b6de-c167a25aa412 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.519085 Jun 22 09:09:55.654926 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 469/942] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:55 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:55.866876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-3c6668d4-acf2-414b-82d1-ffdb4c20bc9a req-e46eb531-7334-4de6-a0fd-24843c71364c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd2ba2e-895b-47db-a4c2-fdd8d75dc726", "name": "network-vif-plugged", "status": "completed", "tag": "b581409a-f9b3-40d0-bace-957da69bd0eb"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:09:55.875733 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-3c6668d4-acf2-414b-82d1-ffdb4c20bc9a req-e46eb531-7334-4de6-a0fd-24843c71364c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.876108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-3c6668d4-acf2-414b-82d1-ffdb4c20bc9a req-e46eb531-7334-4de6-a0fd-24843c71364c service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:55.887694 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-3c6668d4-acf2-414b-82d1-ffdb4c20bc9a req-e46eb531-7334-4de6-a0fd-24843c71364c service nova] Creating event network-vif-plugged:b581409a-f9b3-40d0-bace-957da69bd0eb for instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 on hv-cinder-78729 Jun 22 09:09:55.892294 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-3c6668d4-acf2-414b-82d1-ffdb4c20bc9a req-e46eb531-7334-4de6-a0fd-24843c71364c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033585 Jun 22 09:09:55.892882 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 474/943] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:55.948670 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:55.949275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:55.955970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.956447 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:55.957307 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:55.957937 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:56.210996 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:56.218608 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ec76558e-75f2-42c1-9e02-e5c8182a8ca5 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.273654 Jun 22 09:09:56.219186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 470/944] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:55 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:56.672224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:56.673843 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:56.681544 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:56.681993 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:56.682780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:56.683218 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:56.816150 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:56.823732 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1d0b8e7d-4add-44bb-a1dd-4a6f814d954a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.156085 Jun 22 09:09:56.824298 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 475/945] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:56 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:09:57.236723 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:57.237332 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:57.244348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.244791 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.245542 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.245973 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.248582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:57.378038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:57.386133 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6e2d1900-e43a-4033-8ee4-a82e28b69923 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.153265 Jun 22 09:09:57.386691 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 471/946] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:57 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:57.841532 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:57.841532 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:57.849481 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.851157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.851157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:57.856625 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:57.995562 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:58.003256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1fe9895f-f964-48fe-a886-400cbcb9f39e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1362 microversion: 2.1 time: 0.166280 Jun 22 09:09:58.005426 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 476/947] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:57 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:58.402584 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:58.403189 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:58.409710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.410315 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.411076 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:58.411502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:58.540689 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:58.548085 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9cbfef98-5360-40c6-84e4-38e22a92f21e tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.149331 Jun 22 09:09:58.548647 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 472/948] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:58 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:59.020592 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:59.021206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:59.027863 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.028307 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.029057 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.029488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.162864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:59.170450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-df3a49ba-3b13-49c8-bfea-b27a62a6848b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1548 microversion: 2.1 time: 0.153702 Jun 22 09:09:59.171021 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 477/949] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:59 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:09:59.188393 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-84ec43d5-16d7-47fb-be8d-a6aa6a803982 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:59.188883 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-84ec43d5-16d7-47fb-be8d-a6aa6a803982 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:59.195978 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84ec43d5-16d7-47fb-be8d-a6aa6a803982 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.196424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84ec43d5-16d7-47fb-be8d-a6aa6a803982 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.197173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84ec43d5-16d7-47fb-be8d-a6aa6a803982 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.197598 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84ec43d5-16d7-47fb-be8d-a6aa6a803982 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.278800 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-84ec43d5-16d7-47fb-be8d-a6aa6a803982 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094211 Jun 22 09:09:59.279390 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 473/950] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:09:59 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:09:59.565234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:09:59.566079 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:09:59.572684 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.573136 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.573907 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:09:59.574398 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:09:59.851252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:09:59.859985 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d8170a7c-c01a-4476-9d41-9da86363593c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.298661 Jun 22 09:09:59.860760 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 478/951] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:09:59 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:00.401997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-c6a6ddc2-5e3b-4418-be47-a9d1e07dec60 req-9175590c-cf0a-422b-90f1-8633352f8438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd2ba2e-895b-47db-a4c2-fdd8d75dc726", "tag": "b581409a-f9b3-40d0-bace-957da69bd0eb"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:00.414767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-c6a6ddc2-5e3b-4418-be47-a9d1e07dec60 req-9175590c-cf0a-422b-90f1-8633352f8438 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.415466 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-c6a6ddc2-5e3b-4418-be47-a9d1e07dec60 req-9175590c-cf0a-422b-90f1-8633352f8438 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:00.427953 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-c6a6ddc2-5e3b-4418-be47-a9d1e07dec60 req-9175590c-cf0a-422b-90f1-8633352f8438 service nova] Creating event network-changed:b581409a-f9b3-40d0-bace-957da69bd0eb for instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 on hv-cinder-78729 Jun 22 09:10:00.433042 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-c6a6ddc2-5e3b-4418-be47-a9d1e07dec60 req-9175590c-cf0a-422b-90f1-8633352f8438 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037055 Jun 22 09:10:00.435024 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 474/952] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:00.879878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:00.886530 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:00.888053 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.888505 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:00.889470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:00.889909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:01.072517 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:01.080056 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a1efd3b6-d5b2-4561-9d04-101b0f023c84 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.207151 Jun 22 09:10:01.080821 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 479/953] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:00 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:02.070272 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:02.075541 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=12 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:02.076090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-2365004a-ef62-4f11-9cbe-b92eb88b67b5 req-fdda67f9-5e57-4a9b-9ae7-516875c7eb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512bad88-21fe-437e-8a85-f71503963183", "name": "network-vif-plugged", "status": "completed", "tag": "96d217d4-7f7e-4b48-9765-4d629d4b6509"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:02.086593 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-2365004a-ef62-4f11-9cbe-b92eb88b67b5 req-fdda67f9-5e57-4a9b-9ae7-516875c7eb1f service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:02.087164 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-2365004a-ef62-4f11-9cbe-b92eb88b67b5 req-fdda67f9-5e57-4a9b-9ae7-516875c7eb1f service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:02.097266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:02.098963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:02.099659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-2365004a-ef62-4f11-9cbe-b92eb88b67b5 req-fdda67f9-5e57-4a9b-9ae7-516875c7eb1f service nova] Creating event network-vif-plugged:96d217d4-7f7e-4b48-9765-4d629d4b6509 for instance 512bad88-21fe-437e-8a85-f71503963183 on hv-cinder-78729 Jun 22 09:10:02.100967 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=8 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:02.105068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-2365004a-ef62-4f11-9cbe-b92eb88b67b5 req-fdda67f9-5e57-4a9b-9ae7-516875c7eb1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035419 Jun 22 09:10:02.107378 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 475/954] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:02.108308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:02.108308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:02.108308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:02.108308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:02.254168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:02.262350 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-741a7774-b37c-4723-9131-51fd49d588b7 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.169044 Jun 22 09:10:02.262936 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 480/955] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:02 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:03.279919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:03.280615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:03.288851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:03.289291 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:03.290077 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:03.290506 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:03.436474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:03.444381 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d7b3eb74-9964-4cd2-9188-42051245cd31 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1318 microversion: 2.1 time: 0.168928 Jun 22 09:10:03.444950 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 476/956] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:03 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:04.461592 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:04.462204 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:04.468854 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.469296 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:04.470043 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.470502 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:04.601386 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:04.609215 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-acd9a469-ce1a-4f15-b90d-1d61709047b1 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1507 microversion: 2.1 time: 0.151975 Jun 22 09:10:04.609781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 481/957] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:04 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:04.626224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5789c31e-bfbe-4fd2-b709-132245db3543 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff175d1-c831-4cee-8b7f-d0c101d9105b", "device": "/dev/sdb"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:04.627370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5789c31e-bfbe-4fd2-b709-132245db3543 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:04.633959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5789c31e-bfbe-4fd2-b709-132245db3543 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.636605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5789c31e-bfbe-4fd2-b709-132245db3543 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:04.636605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5789c31e-bfbe-4fd2-b709-132245db3543 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:04.636605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5789c31e-bfbe-4fd2-b709-132245db3543 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:05.418782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5789c31e-bfbe-4fd2-b709-132245db3543 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "POST /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796327 Jun 22 09:10:05.419403 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 477/958] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:10:04 2022] POST /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:25.524870 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:25.525404 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:25.528687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:25.529416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=77 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:25.534178 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:25.534626 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:25.539976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:25.539976 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:25.620822 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lazy-loading 'services' on Instance uuid 512bad88-21fe-437e-8a85-f71503963183 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:10:25.847725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ef26b781-a12f-45f2-b201-208326430413 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "DELETE /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183/os-volume_attachments/4ff175d1-c831-4cee-8b7f-d0c101d9105b" status: 202 len: 0 microversion: 2.1 time: 0.326536 Jun 22 09:10:25.848319 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 482/959] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:10:25 2022] DELETE /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183/os-volume_attachments/4ff175d1-c831-4cee-8b7f-d0c101d9105b => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:10:26.958808 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:26.959591 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:26.964234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:26.965031 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:26.971171 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:26.971613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:26.972411 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:26.972842 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:26.998188 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:10:27.332987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-534815d4-3b2e-49c9-8328-1f8ebb1a9c41 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "DELETE /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 204 len: 0 microversion: 2.1 time: 0.375401 Jun 22 09:10:27.333548 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 478/960] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:10:26 2022] DELETE /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:10:27.343081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:27.343905 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:27.351022 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:27.359175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:27.359175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:27.359175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:27.492100 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:27.500357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f09e1d0d-25ba-4522-9d26-39ee8810ed10 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1513 microversion: 2.1 time: 0.162366 Jun 22 09:10:27.500931 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 483/961] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:27 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:28.517582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:28.518320 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:28.525622 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:28.526244 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:28.527016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:28.527456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:28.659214 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:28.667395 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-770b40af-97e0-4ae3-9bc5-0dced122508c tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1513 microversion: 2.1 time: 0.153580 Jun 22 09:10:28.668157 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 479/962] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:28 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:29.595862 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-4f10834d-1568-4880-a6e8-d38ebdb08f6e req-08e5ed20-bf6e-4e05-bc47-9ae489398bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512bad88-21fe-437e-8a85-f71503963183", "name": "network-vif-deleted", "tag": "96d217d4-7f7e-4b48-9765-4d629d4b6509"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:29.605183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-4f10834d-1568-4880-a6e8-d38ebdb08f6e req-08e5ed20-bf6e-4e05-bc47-9ae489398bd8 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:29.605633 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-4f10834d-1568-4880-a6e8-d38ebdb08f6e req-08e5ed20-bf6e-4e05-bc47-9ae489398bd8 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:29.616564 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-4f10834d-1568-4880-a6e8-d38ebdb08f6e req-08e5ed20-bf6e-4e05-bc47-9ae489398bd8 service nova] Creating event network-vif-deleted:96d217d4-7f7e-4b48-9765-4d629d4b6509 for instance 512bad88-21fe-437e-8a85-f71503963183 on hv-cinder-78729 Jun 22 09:10:29.622176 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-4f10834d-1568-4880-a6e8-d38ebdb08f6e req-08e5ed20-bf6e-4e05-bc47-9ae489398bd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030334 Jun 22 09:10:29.622758 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 484/963] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:29.684015 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:29.684637 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:29.691349 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:29.691799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:29.692575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:29.693016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:29.758047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9e8a4e5a51463c826c821375c1d28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c631e8f3d544309a09e7bf6e39f780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:29.766749 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ea278bab-6b65-4950-9450-4aff72e60980 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 200 len: 1471 microversion: 2.1 time: 0.086734 Jun 22 09:10:29.767355 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 480/964] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:29 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:30.785406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:30.786149 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] [instance: 512bad88-21fe-437e-8a85-f71503963183] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:30.792874 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:30.793940 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:30.794806 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:30.795347 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:30.808857 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] HTTP exception thrown: Instance 512bad88-21fe-437e-8a85-f71503963183 could not be found. Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Request method failure captured: Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 HTTP/1.1 Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistwQzFXBnz_QAJ2vTMAt0_vx3qAFeCxv2jNMI6erQrGWV6tQLYuW9Rl6Sr7TNetolxqAAtU9c96Lftln19P2FK1DY_QIZPoC1sDoBNN-s8m3jjrpqZ5cdc4OUTV9N2GbKS2o4NTqo1KKQL10dRSDP0p9j3x0F6J4xbiNTp3nP1oi08Q Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: d2c631e8f3d544309a09e7bf6e39f780 Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1760635210 Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:10:30.810596 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d2c631e8f3d544309a09e7bf6e39f780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d2c631e8f3d544309a09e7bf6e39f780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d2c631e8f3d544309a09e7bf6e39f780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d2c631e8f3d544309a09e7bf6e39f780"}]}] Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-VolumesSnapshotTestJSON-1760635210 Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: d2c631e8f3d544309a09e7bf6e39f780 Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1760635210 Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-VolumesSnapshotTestJSON-1760635210-project Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 6b9e8a4e5a51463c826c821375c1d28c Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-VolumesSnapshotTestJSON-1760635210-project Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 512bad88-21fe-437e-8a85-f71503963183 could not be found. Jun 22 09:10:30.812233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '512bad88-21fe-437e-8a85-f71503963183'} Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512bad88-21fe-437e-8a85-f71503963183 could not be found. Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:10:30.813009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512bad88-21fe-437e-8a85-f71503963183 could not be found. Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512bad88-21fe-437e-8a85-f71503963183 could not be found. Jun 22 09:10:30.814431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:10:30.815722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] Returning 404 to user: Instance 512bad88-21fe-437e-8a85-f71503963183 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:10:30.815722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-21734dfb-7298-4678-9661-50f87ba9a891 tempest-VolumesSnapshotTestJSON-1760635210 tempest-VolumesSnapshotTestJSON-1760635210-project] 10.222.0.36 "GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183" status: 404 len: 111 microversion: 2.1 time: 0.030820 Jun 22 09:10:30.815722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 485/965] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:30 2022] GET /compute/v2.1/servers/512bad88-21fe-437e-8a85-f71503963183 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:10:36.251135 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-79346ebc-8e6f-4c75-b43b-744bc3eefb5c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:36.251965 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-79346ebc-8e6f-4c75-b43b-744bc3eefb5c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:36.258520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79346ebc-8e6f-4c75-b43b-744bc3eefb5c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.258962 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79346ebc-8e6f-4c75-b43b-744bc3eefb5c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.259739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79346ebc-8e6f-4c75-b43b-744bc3eefb5c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:36.260173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-79346ebc-8e6f-4c75-b43b-744bc3eefb5c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:36.289110 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-79346ebc-8e6f-4c75-b43b-744bc3eefb5c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/ips" status: 200 len: 145 microversion: 2.1 time: 0.041808 Jun 22 09:10:36.289696 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 481/966] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:10:36 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:39.216275 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dbc08ce9-5a19-4dcc-9b5a-407f6190f9ba tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1eeb58a-7abc-4f8c-a296-56f17767204f"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:39.217497 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-dbc08ce9-5a19-4dcc-9b5a-407f6190f9ba tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:39.223806 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dbc08ce9-5a19-4dcc-9b5a-407f6190f9ba tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.224180 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dbc08ce9-5a19-4dcc-9b5a-407f6190f9ba tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:39.224946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dbc08ce9-5a19-4dcc-9b5a-407f6190f9ba tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:39.225383 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dbc08ce9-5a19-4dcc-9b5a-407f6190f9ba tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:40.281918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-dbc08ce9-5a19-4dcc-9b5a-407f6190f9ba tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.069440 Jun 22 09:10:40.282578 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 486/967] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:10:39 2022] POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-volume_attachments => generated 194 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:10:47.785855 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2a91d995-a9e0-41c3-8533-3454b60cef9e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:10:47.788759 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:47.789430 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:47.794206 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a91d995-a9e0-41c3-8533-3454b60cef9e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:47.800111 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2a91d995-a9e0-41c3-8533-3454b60cef9e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:47.858739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2a91d995-a9e0-41c3-8533-3454b60cef9e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Going to try to stop instance {{(pid=118029) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 09:10:48.314385 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2a91d995-a9e0-41c3-8533-3454b60cef9e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action" status: 202 len: 0 microversion: 2.1 time: 0.532431 Jun 22 09:10:48.314974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 482/968] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:10:47 2022] POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:10:48.324473 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:48.325127 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:48.331628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:48.332125 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:48.332780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:48.333211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:48.468147 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:48.477408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-213ef97a-ad3f-468b-9632-6ab222fead88 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.157835 Jun 22 09:10:48.478033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 487/969] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:48 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:49.497690 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:49.498412 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:49.505715 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:49.506210 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.506952 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:49.507382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:49.696481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:49.704460 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-794d81a7-f498-45aa-a04c-d7d8580f311d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.212083 Jun 22 09:10:49.705010 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 483/970] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:49 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:50.722086 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:50.722699 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:50.729722 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.730195 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.730955 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:50.731390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:50.866096 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:50.873972 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c1878c37-c0a4-4efa-a031-d9edbbdfff57 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.155890 Jun 22 09:10:50.874563 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 488/971] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:50 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:51.892921 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:51.893776 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:51.900312 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.900762 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:51.901527 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:51.901968 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:52.035742 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:52.043828 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-736f1bfd-d74e-4599-b57c-92a8ea4d9f7a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.155432 Jun 22 09:10:52.044399 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 484/972] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:51 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:53.061718 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:53.062392 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:53.070232 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:53.070677 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:53.071445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:53.071876 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:53.205415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:53.213873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f9ae0899-940b-4e1a-b2ad-df6f61be3293 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.156153 Jun 22 09:10:53.214516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 489/973] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:53 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:54.232183 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:54.232844 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:54.239550 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:54.239994 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:54.240843 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:54.241182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:54.378945 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:54.385022 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-85a187b1-ba08-4919-b610-7e16253c8282 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.156782 Jun 22 09:10:54.385605 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 485/974] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:54 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:55.403778 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:55.404416 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:55.411159 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.411609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.412365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:55.412806 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:55.811836 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:55.814117 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:55.820906 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bc338e11-12d1-493e-8777-e9284f28e492 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.421061 Jun 22 09:10:55.821558 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 490/975] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:55 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:56.839072 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:56.839704 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:56.849911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:56.849911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:56.849911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:56.849911 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:56.981152 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:56.989370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8ae14d5d-5a3a-4635-a033-12e3522703ac tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.154269 Jun 22 09:10:56.989920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 486/976] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:56 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:58.009090 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:58.009704 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:58.013110 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=19 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:58.018937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:58.019506 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:58.021767 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:58.021767 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:58.168918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:58.177266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e357f168-019a-4278-9a43-7bf853bcd47b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.174155 Jun 22 09:10:58.177835 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 491/977] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:58 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:10:59.194202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:10:59.194980 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:10:59.201977 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:59.202470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:59.203239 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:10:59.203672 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:10:59.338481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:10:59.343840 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cf431184-8655-436d-8906-8d81fb9d0852 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.153566 Jun 22 09:10:59.344407 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 487/978] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:10:59 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:10:59.665966 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:10:59.666605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:11:00.362156 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:00.362767 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:00.370928 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:00.371444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:00.372132 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:00.372563 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:00.515989 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:00.527353 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3746f092-b90f-4e94-b4a7-e55a9e7dad5f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.169393 Jun 22 09:11:00.532107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 492/979] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:00 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:01.549142 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:01.549800 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:01.561371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:01.562136 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:01.563202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:01.563798 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:01.716349 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:01.724407 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a4c8e66e-1a27-417f-ae6b-e8035b1d78b3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.179763 Jun 22 09:11:01.725051 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 488/980] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:01 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:02.744092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:02.744881 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:02.752967 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:02.753738 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:02.755004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:02.755642 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:02.948092 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:02.957479 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d9e35a10-0048-465b-8ad9-18fb529e5ddb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1722 microversion: 2.1 time: 0.218164 Jun 22 09:11:02.958082 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 493/981] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:02 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:03.977174 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:03.978548 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:03.985224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:03.986037 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:03.987092 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:03.987528 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:04.227368 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:04.235881 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-40c3c290-9066-4c21-8154-29fbdde00371 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1699 microversion: 2.1 time: 0.263915 Jun 22 09:11:04.236450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 489/982] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:03 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1699 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:04.254508 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5b37965a-63cf-4f3a-ac56-83bfd9a5b441 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:04.261974 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b37965a-63cf-4f3a-ac56-83bfd9a5b441 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:04.262465 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b37965a-63cf-4f3a-ac56-83bfd9a5b441 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:04.326240 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5b37965a-63cf-4f3a-ac56-83bfd9a5b441 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Going to try to start instance {{(pid=118028) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 09:11:04.629624 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5b37965a-63cf-4f3a-ac56-83bfd9a5b441 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action" status: 202 len: 0 microversion: 2.1 time: 0.378640 Jun 22 09:11:04.630542 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 494/983] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:11:04 2022] POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:04.640581 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:04.641667 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:04.652226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:04.652226 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:04.652836 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:04.653285 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:04.915516 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:04.930370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-830627dc-f5ed-4d05-a6f3-a3684321c674 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1708 microversion: 2.1 time: 0.294333 Jun 22 09:11:04.932992 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 490/984] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:04 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1708 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:05.951697 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:05.952326 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:05.959870 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:05.960392 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:05.961250 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:05.961780 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:06.102234 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:06.114583 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ff5b9332-e9a3-4b45-84ed-67252cb170bc tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1708 microversion: 2.1 time: 0.167097 Jun 22 09:11:06.115727 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 495/985] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:05 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:07.133275 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:07.134454 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:07.141171 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.141654 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.142416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:07.143009 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:07.298835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:07.311425 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b7dc89a9-f67c-4a89-a1ed-8b23d5f10df8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1712 microversion: 2.1 time: 0.179366 Jun 22 09:11:07.311425 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 491/986] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:07 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1712 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:13.325551 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2f826514-4917-494e-8af3-0f695b43b18f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Action: 'create', calling method: .version_select at 0x7fb331f1b790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1710909103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI48J6IX5TSTDT6QwzcUXJVnXPjrcpVzrXhhinrIr/cLF6vAzwosVvk88DR8eJ0X8zLdDr4zKmSNKbUeUKidIYrCQnXY8ubw5SLEePJerWzLP76PW2vrcUSEg0RfqpBDQ=="}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:13.343011 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-2f826514-4917-494e-8af3-0f695b43b18f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for project 0c6571a499a0498abe9211d2d252bacf. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:11:13.347118 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-2f826514-4917-494e-8af3-0f695b43b18f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for user 23089387f4fd454c9a785ff4d51f48c5 and project 0c6571a499a0498abe9211d2d252bacf. Resources: {'key_pairs'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:11:13.439142 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2f826514-4917-494e-8af3-0f695b43b18f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.299647 Jun 22 09:11:13.439751 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 496/987] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:11:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:32.037465 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-458270679", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1710909103", "security_groups": [{"name": "tempest-secgroup-smoke-613264113"}], "block_device_mapping_v2": [{"uuid": "244d72e2-b0da-43ec-8896-fea9fa1c8837", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d777f017-a4b7-4bab-b97e-75143e410eba"}]}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:32.046592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=20 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:32.047248 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:32.153394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] validate_networks() for [('d777f017-a4b7-4bab-b97e-75143e410eba', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:11:32.628355 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:11:32.628781 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:11:32.629242 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:11:32.629649 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:11:32.630072 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:11:32.639259 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.639829 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.640625 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:32.641056 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:32.658662 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for project 0c6571a499a0498abe9211d2d252bacf. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:11:32.662908 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for user 23089387f4fd454c9a785ff4d51f48c5 and project 0c6571a499a0498abe9211d2d252bacf. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:11:32.721508 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:11:32.723668 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='244d72e2-b0da-43ec-8896-fea9fa1c8837',volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:11:33.181027 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5a2705ac-075c-4a41-9f9a-6b69e633614a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.147348 Jun 22 09:11:33.181933 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 492/988] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:11:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:11:33.189081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:33.190262 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:33.191019 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:33.195003 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-24db67e7-12c9-43c2-9d76-371e513c4afa tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:33.195605 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-24db67e7-12c9-43c2-9d76-371e513c4afa tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:33.252239 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-24db67e7-12c9-43c2-9d76-371e513c4afa tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:33.259516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-24db67e7-12c9-43c2-9d76-371e513c4afa tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1094 microversion: 2.1 time: 0.071776 Jun 22 09:11:33.260076 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 497/989] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:33 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:34.277126 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-af47cde9-4290-48a0-b615-d1caf6aa669f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:34.277732 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-af47cde9-4290-48a0-b615-d1caf6aa669f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:34.330491 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-af47cde9-4290-48a0-b615-d1caf6aa669f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:34.337890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-af47cde9-4290-48a0-b615-d1caf6aa669f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1094 microversion: 2.1 time: 0.065070 Jun 22 09:11:34.338475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 493/990] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:34 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:35.356004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:35.356545 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:35.364599 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:35.374602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:35.374602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:35.374602 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:35.463025 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:35.470819 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b564a2e3-d0af-44d2-9248-b76d237190d2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1200 microversion: 2.1 time: 0.118590 Jun 22 09:11:35.485621 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 498/991] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:35 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:36.496212 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:36.496833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:36.504953 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:36.505570 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:36.506519 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:36.507072 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:36.768674 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:36.784687 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-61b54d81-949d-48d1-8a55-584cfa2d4c99 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1277 microversion: 2.1 time: 0.290603 Jun 22 09:11:36.786812 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 494/992] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:36 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:37.373995 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-5a8b0a65-fe4c-4245-bd34-8e41578268b7 req-2c31c1ab-d706-4fa2-a147-ac34574f77b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be70688-3d27-409d-b1fb-66932bb50757", "tag": "7f5477c4-b66e-4f37-be86-8517dbe7b471"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:37.386656 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-5a8b0a65-fe4c-4245-bd34-8e41578268b7 req-2c31c1ab-d706-4fa2-a147-ac34574f77b5 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:37.387104 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-5a8b0a65-fe4c-4245-bd34-8e41578268b7 req-2c31c1ab-d706-4fa2-a147-ac34574f77b5 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:37.399244 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-5a8b0a65-fe4c-4245-bd34-8e41578268b7 req-2c31c1ab-d706-4fa2-a147-ac34574f77b5 service nova] Creating event network-changed:7f5477c4-b66e-4f37-be86-8517dbe7b471 for instance 1be70688-3d27-409d-b1fb-66932bb50757 on hv-cinder-78729 Jun 22 09:11:37.405055 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-5a8b0a65-fe4c-4245-bd34-8e41578268b7 req-2c31c1ab-d706-4fa2-a147-ac34574f77b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114022 Jun 22 09:11:37.405657 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 499/993] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:37.803407 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:37.803941 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:37.811090 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:37.811599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:37.812375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:37.812818 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:37.949487 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:37.957908 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-5bdfd998-301e-4104-8905-c8f01b72c708 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.158406 Jun 22 09:11:37.958499 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 495/994] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:37 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:38.976618 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:38.977315 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:38.984444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:38.984891 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:38.985645 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:38.986089 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:39.126696 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:39.134454 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-31326de5-2211-488e-bd59-7086b3d476cd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.162780 Jun 22 09:11:39.135053 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 500/995] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:38 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:40.151650 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:40.152189 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:40.159377 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:40.159820 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:40.160577 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:40.161005 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:40.294742 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:40.302402 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-31e79045-a66b-4852-9665-3fafe241e06a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.154624 Jun 22 09:11:40.302974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 496/996] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:40 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:41.319611 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:41.347946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:41.347946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:41.347946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:41.347946 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:41.348435 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:41.462655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:41.470720 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1e5a1cf6-f1cf-4e65-ac18-7260a266ce10 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.154997 Jun 22 09:11:41.471278 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 501/997] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:41 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:42.487520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:42.488105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:42.494736 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:42.495179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:42.495930 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:42.496358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:42.627166 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:42.634667 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2295b360-e106-459c-a603-d05b9f114231 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.150989 Jun 22 09:11:42.635215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 497/998] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:42 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:11:42.923279 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:42.923898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:42.930499 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:42.931013 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:42.931773 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:42.932203 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:43.015276 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lazy-loading 'services' on Instance uuid bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:11:43.218396 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-542a62aa-fb3b-4571-a137-388ceff7acdb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-volume_attachments/e1eeb58a-7abc-4f8c-a296-56f17767204f" status: 202 len: 0 microversion: 2.1 time: 0.298859 Jun 22 09:11:43.218990 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 502/999] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:11:42 2022] DELETE /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-volume_attachments/e1eeb58a-7abc-4f8c-a296-56f17767204f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:43.652004 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:43.652603 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:43.655020 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:43.660336 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:43.660786 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:43.661544 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:43.661985 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:43.800909 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:43.808601 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-57a92579-f15c-4d43-bb99-ed8530bef3db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.160449 Jun 22 09:11:43.809296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 498/1000] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:43 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:44.826687 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:44.827384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:44.829381 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:44.834966 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.835414 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.836183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:44.836623 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:44.970662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:44.978446 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6cf39c7f-7016-4ad1-aff7-6a543b882bd9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.156025 Jun 22 09:11:44.979012 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 503/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:44 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:45.387060 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-699d07a4-1d65-4d8f-9f36-05598c86660b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:45.388904 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=8 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:45.394444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-699d07a4-1d65-4d8f-9f36-05598c86660b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:45.394889 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-699d07a4-1d65-4d8f-9f36-05598c86660b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:45.419146 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-699d07a4-1d65-4d8f-9f36-05598c86660b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Going to try to stop instance {{(pid=118029) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 09:11:45.616601 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-699d07a4-1d65-4d8f-9f36-05598c86660b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action" status: 202 len: 0 microversion: 2.1 time: 0.233106 Jun 22 09:11:45.617152 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 499/1002] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:11:45 2022] POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:45.626757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:45.627367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:45.641199 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:45.641665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:45.642444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:45.642878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:45.775493 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:45.784732 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3d8513e3-3f5f-4c6c-bc4c-27f30ccedcd7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.162879 Jun 22 09:11:45.785313 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 504/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:45 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:45.996993 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:45.997788 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:46.004057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.004498 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.005291 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.005791 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.143779 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:46.151250 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b3a6d836-dd4d-402f-9450-7119b4c84112 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.158551 Jun 22 09:11:46.151805 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 500/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:45 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:46.802849 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:46.803446 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:46.810030 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.810515 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.811272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:46.811702 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:46.953077 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:46.960739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-2b411013-563f-4890-b7b9-8e69bfcee108 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.161711 Jun 22 09:11:46.966218 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 505/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:46 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:47.169062 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:47.169606 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:47.176976 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:47.177415 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:47.178215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:47.178657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:47.312712 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:47.320264 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-e73cd2e1-bae8-47ae-98f2-58051f68a2c2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.155416 Jun 22 09:11:47.320814 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 501/1006] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:47 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:47.986669 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:47.987272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:47.993782 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:47.994257 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:47.995009 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:47.995439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.127050 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:48.134690 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a9e9eebc-d5e7-4e0c-91ac-d4758e5755e0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.152048 Jun 22 09:11:48.135248 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 506/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:47 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:48.336872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:48.337482 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:48.344474 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.344924 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.345689 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.346163 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.486386 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:48.494277 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-76e174a5-19aa-4ed0-878b-d1198ff03990 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.161356 Jun 22 09:11:48.495025 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 502/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:48 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:48.527848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-53dfa88b-4f36-4e7d-be9c-993c9e492ef8 req-5ac345df-e0cc-43c8-a2b9-d6c388d09ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be70688-3d27-409d-b1fb-66932bb50757", "name": "network-vif-plugged", "status": "completed", "tag": "7f5477c4-b66e-4f37-be86-8517dbe7b471"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:48.535958 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-53dfa88b-4f36-4e7d-be9c-993c9e492ef8 req-5ac345df-e0cc-43c8-a2b9-d6c388d09ec4 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:48.536394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-53dfa88b-4f36-4e7d-be9c-993c9e492ef8 req-5ac345df-e0cc-43c8-a2b9-d6c388d09ec4 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:48.547755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-53dfa88b-4f36-4e7d-be9c-993c9e492ef8 req-5ac345df-e0cc-43c8-a2b9-d6c388d09ec4 service nova] Creating event network-vif-plugged:7f5477c4-b66e-4f37-be86-8517dbe7b471 for instance 1be70688-3d27-409d-b1fb-66932bb50757 on hv-cinder-78729 Jun 22 09:11:48.552701 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-53dfa88b-4f36-4e7d-be9c-993c9e492ef8 req-5ac345df-e0cc-43c8-a2b9-d6c388d09ec4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086725 Jun 22 09:11:48.553331 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 507/1009] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:11:49.152830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:49.153429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:49.160031 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:49.160470 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:49.161218 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:49.161657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:49.294326 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:49.302289 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b3de37b7-478d-4197-87a9-2caf9a0dc276 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.153370 Jun 22 09:11:49.302866 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 503/1010] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:49 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:49.512848 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:49.513466 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:49.520459 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:49.520907 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:49.521662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:49.522120 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:49.658305 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:49.665781 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-be701077-65c3-42c0-845a-b6f2bee51652 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1265 microversion: 2.1 time: 0.157745 Jun 22 09:11:49.666372 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 508/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:49 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:50.318999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:50.319599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:50.326362 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.330854 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.330854 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.330854 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.461507 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:50.469746 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-55fda745-7b81-4a6d-846c-d2c446a51c5d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.154679 Jun 22 09:11:50.470361 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 504/1012] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:50 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:50.682169 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:50.682715 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:50.689655 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.690130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.690941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.691369 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.825347 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:50.833484 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6b00d99a-a8d9-447b-95e0-d497f1ba7dda tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1452 microversion: 2.1 time: 0.155515 Jun 22 09:11:50.834044 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 509/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:50 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:50.850435 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:50.851038 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:50.857424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.857864 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.858786 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:50.859215 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:50.989717 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:50.997254 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-a8840e49-06c4-4532-8039-2a723f90e6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1452 microversion: 2.1 time: 0.151262 Jun 22 09:11:50.997802 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 505/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:50 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:51.487791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:51.488463 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:51.494539 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:51.497730 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:51.497730 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:51.497730 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:51.716156 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:51.724394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-01c31b9c-ac96-4792-bf00-d947a6255c79 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.241031 Jun 22 09:11:51.725227 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 510/1015] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:51 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:52.742889 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:52.743431 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:52.751133 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:52.751817 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:52.752627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:52.753068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:52.949668 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:52.957804 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0a689d1c-5d0d-47ce-8eba-53112f957f2e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.218894 Jun 22 09:11:52.971239 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 506/1016] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:52 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:53.119183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-9729966f-442e-4acb-88c8-d24cf54e02a9 req-84c3c5f4-2534-4d00-92dc-c826593cf1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be70688-3d27-409d-b1fb-66932bb50757", "tag": "7f5477c4-b66e-4f37-be86-8517dbe7b471"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:53.127693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-9729966f-442e-4acb-88c8-d24cf54e02a9 req-84c3c5f4-2534-4d00-92dc-c826593cf1be service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:53.128140 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-9729966f-442e-4acb-88c8-d24cf54e02a9 req-84c3c5f4-2534-4d00-92dc-c826593cf1be service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:53.139332 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-9729966f-442e-4acb-88c8-d24cf54e02a9 req-84c3c5f4-2534-4d00-92dc-c826593cf1be service nova] Creating event network-changed:7f5477c4-b66e-4f37-be86-8517dbe7b471 for instance 1be70688-3d27-409d-b1fb-66932bb50757 on hv-cinder-78729 Jun 22 09:11:53.145206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-9729966f-442e-4acb-88c8-d24cf54e02a9 req-84c3c5f4-2534-4d00-92dc-c826593cf1be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029617 Jun 22 09:11:53.145809 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 511/1017] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:11:53.975573 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:53.976182 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:53.982665 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:53.983106 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:53.983861 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:53.984298 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:54.118862 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:54.126799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ef785ed1-15c4-4d63-96be-cd44dbfd9653 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.155368 Jun 22 09:11:54.127373 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 507/1018] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:53 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:55.145986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:55.146600 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:55.152797 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:55.153243 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:55.153995 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:55.154451 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:55.285936 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:55.293341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3ded5166-cc00-47bf-a485-2405f51593df tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1676 microversion: 2.1 time: 0.152863 Jun 22 09:11:55.293910 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 512/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:55 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:56.309941 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:56.310575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:56.317638 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.318105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.318869 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.319348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.447183 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:56.454575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-adb414d6-868e-44b0-93ea-a4f3d055bf3f tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1653 microversion: 2.1 time: 0.148531 Jun 22 09:11:56.455134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 508/1020] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:56 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1653 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:56.472071 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8bd479c3-02e1-4ecb-9a4c-3ff71d62c929 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:11:56.478919 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8bd479c3-02e1-4ecb-9a4c-3ff71d62c929 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.479367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8bd479c3-02e1-4ecb-9a4c-3ff71d62c929 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.501157 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8bd479c3-02e1-4ecb-9a4c-3ff71d62c929 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Going to try to start instance {{(pid=118028) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 09:11:56.730362 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8bd479c3-02e1-4ecb-9a4c-3ff71d62c929 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action" status: 202 len: 0 microversion: 2.1 time: 0.262092 Jun 22 09:11:56.730957 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 513/1021] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Jun 22 09:11:56 2022] POST /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:11:56.740036 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:56.740910 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:56.746953 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.747582 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.748350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:56.748783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:56.753525 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:56.886406 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:56.893751 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-572ab83a-9a33-418b-ab56-5591f5042d0d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1662 microversion: 2.1 time: 0.158240 Jun 22 09:11:56.894415 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 509/1022] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:56 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:57.912367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:57.913051 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:57.919320 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:57.919744 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:57.920497 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:57.920927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:58.056571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:58.060139 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:58.064468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-dc7f48ef-58b1-407e-ba7a-c85340226bd0 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1662 microversion: 2.1 time: 0.157010 Jun 22 09:11:58.070174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 514/1023] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:57 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:11:59.083279 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:11:59.083891 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:11:59.090830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:59.091227 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:59.091990 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:11:59.092427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:11:59.222521 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:11:59.230211 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b1efc2da-b248-45f5-a8ab-6acf10b6052b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1666 microversion: 2.1 time: 0.151034 Jun 22 09:11:59.230931 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 510/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:11:59 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:31.236480 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:12:31.237203 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Wed Jun 22 09:12:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:12:32.015357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0367814d-30f8-43ed-a00b-87ce593254c2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.016272 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0367814d-30f8-43ed-a00b-87ce593254c2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.018325 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=38 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:32.023310 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0367814d-30f8-43ed-a00b-87ce593254c2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.028401 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0367814d-30f8-43ed-a00b-87ce593254c2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.028401 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0367814d-30f8-43ed-a00b-87ce593254c2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.028401 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0367814d-30f8-43ed-a00b-87ce593254c2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.054252 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0367814d-30f8-43ed-a00b-87ce593254c2 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043300 Jun 22 09:12:32.054811 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 515/1025] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 09:12:32.117050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.117542 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.119767 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:32.120397 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=10 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:32.125063 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.125544 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.126329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.126756 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.152555 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:12:32.440613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b3a63045-f5fb-4785-8964-f55fce39ed6c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 204 len: 0 microversion: 2.1 time: 0.327060 Jun 22 09:12:32.441294 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 511/1026] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:12:32 2022] DELETE /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 09:12:32.450735 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:32.451349 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:32.457842 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.458317 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.459076 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:32.459514 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:32.588996 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:32.596472 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1e8b5f89-9625-4ded-aa8f-ae9f1dabf965 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1672 microversion: 2.1 time: 0.150780 Jun 22 09:12:32.596941 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 516/1027] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:32 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:33.613766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:33.614486 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:33.621455 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.621897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.622705 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:33.623131 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:33.758669 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:33.767086 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-af26cc56-9f01-42d7-b8a5-3a402b9ad758 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1672 microversion: 2.1 time: 0.157510 Jun 22 09:12:33.767641 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 512/1028] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:33 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:34.784680 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:34.785461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:34.792894 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.793350 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:34.794155 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:34.794593 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.199382 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:35.207111 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0125694c-adac-4e86-9f3a-8fc03f2482de tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1672 microversion: 2.1 time: 0.426424 Jun 22 09:12:35.207709 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 517/1029] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:34 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1672 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:35.618502 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-d3f13064-a17c-4e1a-b8d5-12e884e287d2 req-ca973c58-2ee9-47db-a630-6e911a4de561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd2ba2e-895b-47db-a4c2-fdd8d75dc726", "name": "network-vif-deleted", "tag": "b581409a-f9b3-40d0-bace-957da69bd0eb"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:35.627071 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d3f13064-a17c-4e1a-b8d5-12e884e287d2 req-ca973c58-2ee9-47db-a630-6e911a4de561 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:35.630197 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d3f13064-a17c-4e1a-b8d5-12e884e287d2 req-ca973c58-2ee9-47db-a630-6e911a4de561 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:35.638944 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-d3f13064-a17c-4e1a-b8d5-12e884e287d2 req-ca973c58-2ee9-47db-a630-6e911a4de561 service nova] Creating event network-vif-deleted:b581409a-f9b3-40d0-bace-957da69bd0eb for instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 on hv-cinder-78729 Jun 22 09:12:35.643975 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-d3f13064-a17c-4e1a-b8d5-12e884e287d2 req-ca973c58-2ee9-47db-a630-6e911a4de561 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029299 Jun 22 09:12:35.644554 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 513/1030] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:36.225039 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:36.227984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:36.232506 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.232887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.233648 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.234099 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.267255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:36.267691 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:36.268138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.objects.instance [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lazy-loading 'fault' on Instance uuid bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 {{(pid=118028) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:12:36.312668 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:36.320266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-dc5568bc-6064-49db-aa41-b8a0c53a6301 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 200 len: 1326 microversion: 2.1 time: 0.099254 Jun 22 09:12:36.320838 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 518/1031] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:36 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:36.576628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:12:36.576846 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:12:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:12:37.340376 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:37.341092 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:37.347427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.347894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.348655 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:37.349422 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:37.365128 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] HTTP exception thrown: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Request method failure captured: Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 HTTP/1.1 Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistxTeAewBFfDek9IOQDxJ6MWzUEcfPyO7SW5987sAlAva-bKGnQOU8QsnG4-jTW-JX_SoqIQw8YWRB-2wIHjNT4CaUk98qasCpV1Ck5AL6AvzbvrCH_jtPH3qQoF9Wp-kQFE_nH6ya9yvG9L65DShriTrDAJJ-5h_wca9DhW4hsc0TM Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:12:37.366826 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}] Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 322de5283c4e40ebb3911456f96812cb Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:12:37.368504 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'bcd2ba2e-895b-47db-a4c2-fdd8d75dc726'} Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:12:37.369547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:12:37.371456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:12:37.373138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Returning 404 to user: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:12:37.373138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cc747910-bdc9-4fdc-8289-4938f6fdc9e7 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 404 len: 111 microversion: 2.1 time: 0.033545 Jun 22 09:12:37.373138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 514/1032] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:37 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:12:37.378170 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-94efc775-a5fb-4994-b6aa-b3da1129d918 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '.version_select at 0x7fb332062f70>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:37.487405 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-94efc775-a5fb-4994-b6aa-b3da1129d918 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800785142" status: 202 len: 0 microversion: 2.1 time: 0.113525 Jun 22 09:12:37.487980 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 519/1033] 10.222.0.36 () {58 vars in 1217 bytes} [Wed Jun 22 09:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800785142 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:12:38.253416 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fcb764c5-7233-47f9-a186-511f55fc42a8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'create', calling method: .version_select at 0x7fb331f739d0>, body: {"keypair": {"name": "tempest-keypair-1845683616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx3IrCRLyx9xqDeTnZ3rZUJH4VmOf7pWQYUp+7GEysheAmi3kPDLLE6XbjABAQ4qFDChBn4+RrYmtXlJaWInypuUdk/9q/nISvF3M5cVEw7FcWTCQs7DHurM6usvLvYlA=="}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:38.268915 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-fcb764c5-7233-47f9-a186-511f55fc42a8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for project 39db61e788d04620a94bb0ddea0cd726. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:38.272773 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-fcb764c5-7233-47f9-a186-511f55fc42a8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for user 322de5283c4e40ebb3911456f96812cb and project 39db61e788d04620a94bb0ddea0cd726. Resources: {'key_pairs'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:38.357290 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fcb764c5-7233-47f9-a186-511f55fc42a8 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107778 Jun 22 09:12:38.357999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 515/1034] 10.222.0.36 () {60 vars in 1158 bytes} [Wed Jun 22 09:12:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:40.625637 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-911441549", "imageRef": "70e07e7d-7670-4ad0-b207-24b0ee4e00cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b046ebff-06e8-420c-9d94-82044ffbff87"}], "security_groups": [{"name": "tempest-securitygroup--560492669"}], "key_name": "tempest-keypair-1845683616", "user_data": "}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:40.732757 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.network.neutron [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] validate_networks() for [('b046ebff-06e8-420c-9d94-82044ffbff87', None, None, None, None, None)] {{(pid=118028) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:12:41.161070 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Flavor limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:12:41.161489 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Image limits 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:12:41.161965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Flavor pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:12:41.162415 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Image pref 0:0:0 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:12:41.162822 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.virt.hardware [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118028) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:12:41.172381 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:41.172995 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:41.173586 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:41.174035 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:41.192004 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for project 39db61e788d04620a94bb0ddea0cd726. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:12:41.196707 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.quota [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Getting quotas for user 322de5283c4e40ebb3911456f96812cb and project 39db61e788d04620a94bb0ddea0cd726. Resources: {'cores', 'instances', 'ram'} {{(pid=118028) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:12:41.209090 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Going to run 1 instances... {{(pid=118028) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:12:41.211370 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70e07e7d-7670-4ad0-b207-24b0ee4e00cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118028) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:12:41.353608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-189634d7-f86a-4661-9b8a-3921e6b678bb tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.733391 Jun 22 09:12:41.354192 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 520/1035] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:12:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:12:41.365424 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-13478a48-d8f5-4514-97ba-0e1c7aa09f16 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:41.366154 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-13478a48-d8f5-4514-97ba-0e1c7aa09f16 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:41.423071 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-13478a48-d8f5-4514-97ba-0e1c7aa09f16 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:41.429854 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-13478a48-d8f5-4514-97ba-0e1c7aa09f16 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1237 microversion: 2.1 time: 0.068802 Jun 22 09:12:41.430449 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 516/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:41 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:42.452024 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:42.453508 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:42.462108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:42.462808 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:42.463675 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:42.464168 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:42.546939 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:42.554758 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-71c1cbe7-6a20-42c3-9c0d-be18f3694c58 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1241 microversion: 2.1 time: 0.108799 Jun 22 09:12:42.557954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 521/1037] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:42 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:43.572727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:43.573337 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:43.581271 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.581723 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.582524 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:43.582964 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:43.674184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:43.682798 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0425d18f-d4a0-48b6-b398-dda92e6e905c tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1307 microversion: 2.1 time: 0.113981 Jun 22 09:12:43.683351 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 517/1038] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:43 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:44.701403 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:44.702022 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:44.709065 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.709592 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:44.710404 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:44.710841 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:44.918635 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:44.926319 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5b7f6e34-7c26-4558-925d-14b9ceaf0024 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1362 microversion: 2.1 time: 0.229386 Jun 22 09:12:44.926898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 522/1039] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:44 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:45.028999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-7171c415-5027-4298-a1e5-dd2349c2087f req-06d88e74-7060-4b1d-b6eb-70f0633707a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13bcf3b-4896-4b0c-ad30-1c177d98234d", "tag": "807e5706-8a79-47a3-aa22-e2de3ca4df0e"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:45.045217 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-7171c415-5027-4298-a1e5-dd2349c2087f req-06d88e74-7060-4b1d-b6eb-70f0633707a6 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.045936 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-7171c415-5027-4298-a1e5-dd2349c2087f req-06d88e74-7060-4b1d-b6eb-70f0633707a6 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.062611 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-7171c415-5027-4298-a1e5-dd2349c2087f req-06d88e74-7060-4b1d-b6eb-70f0633707a6 service nova] Creating event network-changed:807e5706-8a79-47a3-aa22-e2de3ca4df0e for instance a13bcf3b-4896-4b0c-ad30-1c177d98234d on hv-cinder-78729 Jun 22 09:12:45.066640 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-7171c415-5027-4298-a1e5-dd2349c2087f req-06d88e74-7060-4b1d-b6eb-70f0633707a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041995 Jun 22 09:12:45.067481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 518/1040] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:45.948020 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:45.948588 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:45.955676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.956130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:45.956901 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:45.957341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:46.093141 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:46.100936 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-5135b46f-97ad-4be4-909e-5ebf7df7c0e3 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1362 microversion: 2.1 time: 0.156876 Jun 22 09:12:46.101494 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 523/1041] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:45 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:47.118007 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:47.118740 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:47.125351 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.125791 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.126615 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:47.127045 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:47.256563 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:47.264467 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4df955c0-9169-4d64-92bb-1c0dab05253e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1362 microversion: 2.1 time: 0.150713 Jun 22 09:12:47.265039 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 519/1042] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:47 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:48.281993 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:48.282633 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:48.289256 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:48.289705 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:48.290503 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:48.290938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:48.422670 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:48.430607 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-06b8d2a3-ad87-485f-b8f7-9dc45bcfde8a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1362 microversion: 2.1 time: 0.153257 Jun 22 09:12:48.431167 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 524/1043] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:48 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:49.448476 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:49.449076 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:49.455696 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.456140 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.456890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:49.457321 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:49.584201 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:49.592059 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-17ff2c8a-1c75-469e-906b-01d6eeaa7452 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1362 microversion: 2.1 time: 0.147148 Jun 22 09:12:49.592613 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 520/1044] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:49 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:50.608902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:50.609667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:50.616184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.616633 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.617390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.617823 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.741303 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-36c8979c-e000-4808-b250-3df83bad40bf req-6522d192-e658-4391-9713-1fd686ff3dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13bcf3b-4896-4b0c-ad30-1c177d98234d", "name": "network-vif-plugged", "status": "completed", "tag": "807e5706-8a79-47a3-aa22-e2de3ca4df0e"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:50.750216 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-36c8979c-e000-4808-b250-3df83bad40bf req-6522d192-e658-4391-9713-1fd686ff3dcd service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:50.750581 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-36c8979c-e000-4808-b250-3df83bad40bf req-6522d192-e658-4391-9713-1fd686ff3dcd service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:50.756306 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:50.761627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-36c8979c-e000-4808-b250-3df83bad40bf req-6522d192-e658-4391-9713-1fd686ff3dcd service nova] Creating event network-vif-plugged:807e5706-8a79-47a3-aa22-e2de3ca4df0e for instance a13bcf3b-4896-4b0c-ad30-1c177d98234d on hv-cinder-78729 Jun 22 09:12:50.764992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6304066f-514b-4526-bb0d-2c54e3f31725 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1362 microversion: 2.1 time: 0.159816 Jun 22 09:12:50.766232 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 525/1045] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:50 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:50.767255 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-36c8979c-e000-4808-b250-3df83bad40bf req-6522d192-e658-4391-9713-1fd686ff3dcd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029499 Jun 22 09:12:50.767894 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 521/1046] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:12:51.784210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:51.784828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:51.786766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:51.787445 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=6 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:51.792743 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.793190 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.793981 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:51.794520 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:51.924250 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:51.931614 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c93a24e1-62c5-4902-ad96-1497dc476812 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1362 microversion: 2.1 time: 0.151380 Jun 22 09:12:51.932172 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 526/1047] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:51 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:52.945631 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=6 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:52.950083 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:52.954575 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:52.957831 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.958379 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:52.959137 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:52.959565 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.092799 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:12:53.100498 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9b61b2b3-a19a-47bb-b789-3605c7871062 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1548 microversion: 2.1 time: 0.155905 Jun 22 09:12:53.101050 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 522/1048] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:12:52 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:12:53.117561 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6ab0d9dc-45f4-4e40-8e8e-246a4c27a9b4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:12:53.118203 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6ab0d9dc-45f4-4e40-8e8e-246a4c27a9b4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:12:53.124766 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ab0d9dc-45f4-4e40-8e8e-246a4c27a9b4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.125217 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ab0d9dc-45f4-4e40-8e8e-246a4c27a9b4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.125987 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ab0d9dc-45f4-4e40-8e8e-246a4c27a9b4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:53.126450 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6ab0d9dc-45f4-4e40-8e8e-246a4c27a9b4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:53.203462 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6ab0d9dc-45f4-4e40-8e8e-246a4c27a9b4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089751 Jun 22 09:12:53.204054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 527/1049] 10.222.0.36 () {58 vars in 1274 bytes} [Wed Jun 22 09:12:53 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:12:54.457068 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-0088a814-94fd-4af0-a7b7-72db98970fca req-3307faca-1edc-4818-be87-841308e9cde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13bcf3b-4896-4b0c-ad30-1c177d98234d", "tag": "807e5706-8a79-47a3-aa22-e2de3ca4df0e"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:12:54.465674 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0088a814-94fd-4af0-a7b7-72db98970fca req-3307faca-1edc-4818-be87-841308e9cde1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:12:54.466789 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-0088a814-94fd-4af0-a7b7-72db98970fca req-3307faca-1edc-4818-be87-841308e9cde1 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:12:54.477959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-0088a814-94fd-4af0-a7b7-72db98970fca req-3307faca-1edc-4818-be87-841308e9cde1 service nova] Creating event network-changed:807e5706-8a79-47a3-aa22-e2de3ca4df0e for instance a13bcf3b-4896-4b0c-ad30-1c177d98234d on hv-cinder-78729 Jun 22 09:12:54.482887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-0088a814-94fd-4af0-a7b7-72db98970fca req-3307faca-1edc-4818-be87-841308e9cde1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029430 Jun 22 09:12:54.483660 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 523/1050] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:23.973731 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:23.974500 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=68 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:23.978367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1a22eff6-964a-443e-8d13-9905022ae0d4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:23.986700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1a22eff6-964a-443e-8d13-9905022ae0d4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:23.986700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1a22eff6-964a-443e-8d13-9905022ae0d4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.986700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1a22eff6-964a-443e-8d13-9905022ae0d4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:23.986700 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1a22eff6-964a-443e-8d13-9905022ae0d4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:23.987253 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1a22eff6-964a-443e-8d13-9905022ae0d4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:24.014568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1a22eff6-964a-443e-8d13-9905022ae0d4 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/ips" status: 200 len: 146 microversion: 2.1 time: 0.042438 Jun 22 09:13:24.015132 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 528/1051] 10.222.0.36 () {58 vars in 1247 bytes} [Wed Jun 22 09:13:23 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:25.555220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:25.555971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:25.560206 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-28604c85-1ddf-42c4-98ac-3cb6170ce373 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c01afe-40c6-4919-85cb-5f672d027469"}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:25.561370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-28604c85-1ddf-42c4-98ac-3cb6170ce373 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:25.568245 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28604c85-1ddf-42c4-98ac-3cb6170ce373 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:25.574701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28604c85-1ddf-42c4-98ac-3cb6170ce373 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:25.574701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28604c85-1ddf-42c4-98ac-3cb6170ce373 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:25.574701 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28604c85-1ddf-42c4-98ac-3cb6170ce373 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:26.374886 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-28604c85-1ddf-42c4-98ac-3cb6170ce373 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820982 Jun 22 09:13:26.375505 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 524/1052] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:13:25 2022] POST /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:33.862044 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-06ec2a8d-b256-48ef-8197-518505476701 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:33.863073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-06ec2a8d-b256-48ef-8197-518505476701 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:33.869798 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06ec2a8d-b256-48ef-8197-518505476701 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.870379 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06ec2a8d-b256-48ef-8197-518505476701 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.871171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06ec2a8d-b256-48ef-8197-518505476701 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.871608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-06ec2a8d-b256-48ef-8197-518505476701 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.900424 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-06ec2a8d-b256-48ef-8197-518505476701 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042768 Jun 22 09:13:33.900966 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 529/1053] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:33 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:33.912556 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1ae86777-a4da-4bb4-b647-7c3cdaca8234 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:33.913137 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1ae86777-a4da-4bb4-b647-7c3cdaca8234 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:33.919681 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ae86777-a4da-4bb4-b647-7c3cdaca8234 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.920121 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ae86777-a4da-4bb4-b647-7c3cdaca8234 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.920872 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ae86777-a4da-4bb4-b647-7c3cdaca8234 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:33.921299 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1ae86777-a4da-4bb4-b647-7c3cdaca8234 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:33.951947 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1ae86777-a4da-4bb4-b647-7c3cdaca8234 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/d1c01afe-40c6-4919-85cb-5f672d027469" status: 200 len: 194 microversion: 2.1 time: 0.044123 Jun 22 09:13:33.952536 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 525/1054] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Jun 22 09:13:33 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/d1c01afe-40c6-4919-85cb-5f672d027469 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:35.553932 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-45c6e8e0-2076-48ac-9fbc-51607016e95b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cf93e29-9225-4e4c-8120-8ba52ae34e8f"}} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:35.555010 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-45c6e8e0-2076-48ac-9fbc-51607016e95b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:35.562873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45c6e8e0-2076-48ac-9fbc-51607016e95b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.563309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45c6e8e0-2076-48ac-9fbc-51607016e95b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:35.564059 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45c6e8e0-2076-48ac-9fbc-51607016e95b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:35.564487 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-45c6e8e0-2076-48ac-9fbc-51607016e95b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:36.174748 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-45c6e8e0-2076-48ac-9fbc-51607016e95b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "POST /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624513 Jun 22 09:13:36.175299 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 530/1055] 10.222.0.36 () {60 vars in 1322 bytes} [Wed Jun 22 09:13:35 2022] POST /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:43.665686 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-84f0de91-ab3a-414a-bbd6-24365d908e10 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:43.666628 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-84f0de91-ab3a-414a-bbd6-24365d908e10 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:43.674273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84f0de91-ab3a-414a-bbd6-24365d908e10 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.674727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84f0de91-ab3a-414a-bbd6-24365d908e10 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.675494 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84f0de91-ab3a-414a-bbd6-24365d908e10 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.675948 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-84f0de91-ab3a-414a-bbd6-24365d908e10 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.705903 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-84f0de91-ab3a-414a-bbd6-24365d908e10 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044088 Jun 22 09:13:43.706507 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 526/1056] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:43 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:43.849719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-090e234c-67f3-44e2-84c7-1c2aaae1357b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:43.850348 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-090e234c-67f3-44e2-84c7-1c2aaae1357b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:43.857200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-090e234c-67f3-44e2-84c7-1c2aaae1357b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.857646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-090e234c-67f3-44e2-84c7-1c2aaae1357b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.858431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-090e234c-67f3-44e2-84c7-1c2aaae1357b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.858869 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-090e234c-67f3-44e2-84c7-1c2aaae1357b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.889631 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-090e234c-67f3-44e2-84c7-1c2aaae1357b tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/d1c01afe-40c6-4919-85cb-5f672d027469" status: 200 len: 194 microversion: 2.1 time: 0.044825 Jun 22 09:13:43.890173 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 531/1057] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Jun 22 09:13:43 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/d1c01afe-40c6-4919-85cb-5f672d027469 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:43.900418 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:43.900943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:43.908406 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.908970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.909723 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:43.910258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:43.995460 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lazy-loading 'services' on Instance uuid a13bcf3b-4896-4b0c-ad30-1c177d98234d {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:44.192999 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-52f883cb-6ccb-4b2a-b36b-ef78b6d76620 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/d1c01afe-40c6-4919-85cb-5f672d027469" status: 202 len: 0 microversion: 2.1 time: 0.296327 Jun 22 09:13:44.193514 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 527/1058] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:13:43 2022] DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/d1c01afe-40c6-4919-85cb-5f672d027469 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:13:45.306938 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ef0ccefb-8753-4e90-ac00-de92e0b61b83 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:45.307488 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ef0ccefb-8753-4e90-ac00-de92e0b61b83 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:45.314513 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef0ccefb-8753-4e90-ac00-de92e0b61b83 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.314956 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef0ccefb-8753-4e90-ac00-de92e0b61b83 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.315745 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef0ccefb-8753-4e90-ac00-de92e0b61b83 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.316175 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef0ccefb-8753-4e90-ac00-de92e0b61b83 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.345083 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ef0ccefb-8753-4e90-ac00-de92e0b61b83 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/6cf93e29-9225-4e4c-8120-8ba52ae34e8f" status: 200 len: 194 microversion: 2.1 time: 0.042062 Jun 22 09:13:45.346927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 532/1059] 10.222.0.36 () {58 vars in 1412 bytes} [Wed Jun 22 09:13:45 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/6cf93e29-9225-4e4c-8120-8ba52ae34e8f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:45.357651 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:45.358266 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:45.364626 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.365073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.365828 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:45.366296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:45.449224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lazy-loading 'services' on Instance uuid a13bcf3b-4896-4b0c-ad30-1c177d98234d {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:45.649262 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-1cd74678-46ef-46df-b6b0-86b2c2db761d tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/6cf93e29-9225-4e4c-8120-8ba52ae34e8f" status: 202 len: 0 microversion: 2.1 time: 0.297025 Jun 22 09:13:45.649890 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 528/1060] 10.222.0.36 () {58 vars in 1415 bytes} [Wed Jun 22 09:13:45 2022] DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments/6cf93e29-9225-4e4c-8120-8ba52ae34e8f => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:13:46.812184 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bbf1a2d1-d8aa-4f82-ae42-68f1d65462ef tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:46.813112 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bbf1a2d1-d8aa-4f82-ae42-68f1d65462ef tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:46.819846 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bbf1a2d1-d8aa-4f82-ae42-68f1d65462ef tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.820298 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bbf1a2d1-d8aa-4f82-ae42-68f1d65462ef tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.821056 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bbf1a2d1-d8aa-4f82-ae42-68f1d65462ef tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.821491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bbf1a2d1-d8aa-4f82-ae42-68f1d65462ef tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.851211 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bbf1a2d1-d8aa-4f82-ae42-68f1d65462ef tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043471 Jun 22 09:13:46.851786 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 533/1061] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:46 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:13:46.959196 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d4fc37f8-bab9-48aa-8309-955af41e6c1a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:46.960273 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d4fc37f8-bab9-48aa-8309-955af41e6c1a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:46.966653 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4fc37f8-bab9-48aa-8309-955af41e6c1a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.967100 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4fc37f8-bab9-48aa-8309-955af41e6c1a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.968082 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4fc37f8-bab9-48aa-8309-955af41e6c1a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:46.968520 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4fc37f8-bab9-48aa-8309-955af41e6c1a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:46.996934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d4fc37f8-bab9-48aa-8309-955af41e6c1a tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042474 Jun 22 09:13:46.997499 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 529/1062] 10.222.0.36 () {58 vars in 1301 bytes} [Wed Jun 22 09:13:46 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 09:13:47.056629 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:47.057122 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:47.063991 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.064457 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.065266 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.065864 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.091215 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:13:47.353120 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-49d0c5f8-ee37-44d9-8b04-9eacf60790c6 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 204 len: 0 microversion: 2.1 time: 0.300096 Jun 22 09:13:47.353639 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 534/1063] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:47 2022] DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:13:47.362643 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:47.363347 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:47.369600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.370047 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.370866 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:47.371304 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:47.503853 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:47.511291 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d4f0e225-2e06-4730-a589-3d20e64db5ea tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1673 microversion: 2.1 time: 0.153325 Jun 22 09:13:47.511854 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 530/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:47 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:48.530725 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:48.531438 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:48.537937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.538434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:48.539205 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:48.539646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:48.675086 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:48.682134 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4d10dedc-8210-44b8-8e2f-72d9fe6d38b9 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1673 microversion: 2.1 time: 0.156019 Jun 22 09:13:48.682695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 535/1065] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:48 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:49.700070 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:49.700695 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:49.708084 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:49.708536 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.709306 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:49.709789 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.775952 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322de5283c4e40ebb3911456f96812cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39db61e788d04620a94bb0ddea0cd726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:49.784619 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-2c7636ed-6db9-407a-8135-550270f84368 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 200 len: 1606 microversion: 2.1 time: 0.088469 Jun 22 09:13:49.785193 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 531/1066] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:49 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:49.931188 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-1de0e074-6373-4e85-a9f4-a18374926b22 req-3ab3e918-9c16-43ff-aad5-5d667cf91c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13bcf3b-4896-4b0c-ad30-1c177d98234d", "name": "network-vif-deleted", "tag": "807e5706-8a79-47a3-aa22-e2de3ca4df0e"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:49.945216 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-1de0e074-6373-4e85-a9f4-a18374926b22 req-3ab3e918-9c16-43ff-aad5-5d667cf91c4e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:49.945216 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-1de0e074-6373-4e85-a9f4-a18374926b22 req-3ab3e918-9c16-43ff-aad5-5d667cf91c4e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:49.954619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-1de0e074-6373-4e85-a9f4-a18374926b22 req-3ab3e918-9c16-43ff-aad5-5d667cf91c4e service nova] Creating event network-vif-deleted:807e5706-8a79-47a3-aa22-e2de3ca4df0e for instance a13bcf3b-4896-4b0c-ad30-1c177d98234d on hv-cinder-78729 Jun 22 09:13:49.960357 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-1de0e074-6373-4e85-a9f4-a18374926b22 req-3ab3e918-9c16-43ff-aad5-5d667cf91c4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032892 Jun 22 09:13:49.960960 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 536/1067] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:50.587510 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.588013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.594224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.594663 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.595444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.596058 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.620483 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Going to try to terminate instance {{(pid=118029) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:13:50.803878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.804622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.813149 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.814089 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.814922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.815365 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.831894 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] HTTP exception thrown: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Request method failure captured: Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d HTTP/1.1 Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistxTeAewBFfDek9IOQDxJ6MWzUEcfPyO7SW5987sAlAva-bKGnQOU8QsnG4-jTW-JX_SoqIQw8YWRB-2wIHjNT4CaUk98qasCpV1Ck5AL6AvzbvrCH_jtPH3qQoF9Wp-kQFE_nH6ya9yvG9L65DShriTrDAJJ-5h_wca9DhW4hsc0TM Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:13:50.833584 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}] Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 322de5283c4e40ebb3911456f96812cb Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:50.835200 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'a13bcf3b-4896-4b0c-ad30-1c177d98234d'} Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:50.836367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:50.837927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:50.839492 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Returning 404 to user: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:50.839492 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-aafa527e-19f4-49ef-bf9c-4d7d0f5524b5 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 404 len: 111 microversion: 2.1 time: 0.036863 Jun 22 09:13:50.839492 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 537/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:50 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:50.844662 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-34c8befa-9705-47a3-9374-9ce33a432088 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '.version_select at 0x7fb332062790>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.896274 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-062e9f57-7c0b-4a8d-a3c9-25c52b87bafc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 204 len: 0 microversion: 2.1 time: 0.312511 Jun 22 09:13:50.896963 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 532/1069] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:50 2022] DELETE /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:13:50.906526 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:50.907229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:50.913387 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.913830 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.914618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:50.915232 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:50.960314 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-34c8befa-9705-47a3-9374-9ce33a432088 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845683616" status: 202 len: 0 microversion: 2.1 time: 0.119565 Jun 22 09:13:50.961203 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 538/1070] 10.222.0.36 () {58 vars in 1220 bytes} [Wed Jun 22 09:13:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845683616 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 09:13:51.065997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:51.073467 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-58f96427-6d6c-41a6-bb7e-5e96745c5f3b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1577 microversion: 2.1 time: 0.172106 Jun 22 09:13:51.074045 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 533/1071] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:50 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:52.093820 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:52.094422 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:52.102026 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.102640 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:52.103431 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:52.103909 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:52.250205 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:52.258094 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-cdfbef3a-f20a-4c06-97d5-bd53ab2c618f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1577 microversion: 2.1 time: 0.169804 Jun 22 09:13:52.258665 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 539/1072] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:52 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:53.262165 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-d0252279-f994-4cf9-bd3d-87e1944be716 req-2d74cb6c-b68d-45ad-8785-f0f6dcb4cc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be70688-3d27-409d-b1fb-66932bb50757", "name": "network-vif-deleted", "tag": "7f5477c4-b66e-4f37-be86-8517dbe7b471"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:53.275470 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:53.276434 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:53.284965 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:53.285409 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.286208 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:53.286711 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.292972 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d0252279-f994-4cf9-bd3d-87e1944be716 req-2d74cb6c-b68d-45ad-8785-f0f6dcb4cc7e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:53.293417 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-d0252279-f994-4cf9-bd3d-87e1944be716 req-2d74cb6c-b68d-45ad-8785-f0f6dcb4cc7e service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:53.313938 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-d0252279-f994-4cf9-bd3d-87e1944be716 req-2d74cb6c-b68d-45ad-8785-f0f6dcb4cc7e service nova] Creating event network-vif-deleted:7f5477c4-b66e-4f37-be86-8517dbe7b471 for instance 1be70688-3d27-409d-b1fb-66932bb50757 on hv-cinder-78729 Jun 22 09:13:53.320407 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-d0252279-f994-4cf9-bd3d-87e1944be716 req-2d74cb6c-b68d-45ad-8785-f0f6dcb4cc7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062460 Jun 22 09:13:53.321007 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 534/1073] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:13:53.381069 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:53.389351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9b128890-8439-4140-bd0a-610cb0dd7043 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1510 microversion: 2.1 time: 0.117198 Jun 22 09:13:53.399103 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 540/1074] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:53 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1510 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:13:54.258405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:54.260051 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:54.266314 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.267009 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.267539 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.267973 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.283350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] HTTP exception thrown: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Request method failure captured: Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d HTTP/1.1 Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistxTeAewBFfDek9IOQDxJ6MWzUEcfPyO7SW5987sAlAva-bKGnQOU8QsnG4-jTW-JX_SoqIQw8YWRB-2wIHjNT4CaUk98qasCpV1Ck5AL6AvzbvrCH_jtPH3qQoF9Wp-kQFE_nH6ya9yvG9L65DShriTrDAJJ-5h_wca9DhW4hsc0TM Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:13:54.285293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}] Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 322de5283c4e40ebb3911456f96812cb Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.286934 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'a13bcf3b-4896-4b0c-ad30-1c177d98234d'} Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:54.287913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.289252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.290558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Returning 404 to user: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:54.290558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8f5fe8d3-4ec4-47f8-92e3-4d72f5cae832 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 404 len: 111 microversion: 2.1 time: 0.033380 Jun 22 09:13:54.290558 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 535/1075] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:54 2022] DELETE /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:54.296764 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:54.297388 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: a13bcf3b-4896-4b0c-ad30-1c177d98234d] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:54.304156 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.304613 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.305885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.305885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.320977 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] HTTP exception thrown: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Request method failure captured: Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d HTTP/1.1 Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistxTeAewBFfDek9IOQDxJ6MWzUEcfPyO7SW5987sAlAva-bKGnQOU8QsnG4-jTW-JX_SoqIQw8YWRB-2wIHjNT4CaUk98qasCpV1Ck5AL6AvzbvrCH_jtPH3qQoF9Wp-kQFE_nH6ya9yvG9L65DShriTrDAJJ-5h_wca9DhW4hsc0TM Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:13:54.322565 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}] Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 322de5283c4e40ebb3911456f96812cb Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.324231 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'a13bcf3b-4896-4b0c-ad30-1c177d98234d'} Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:54.325097 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. Jun 22 09:13:54.332153 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:54.333926 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Returning 404 to user: Instance a13bcf3b-4896-4b0c-ad30-1c177d98234d could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:54.333926 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a413f205-157e-4cb9-ab1e-fc94f2bd2b4e tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d" status: 404 len: 111 microversion: 2.1 time: 0.032537 Jun 22 09:13:54.333926 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 541/1076] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:54 2022] GET /compute/v2.1/servers/a13bcf3b-4896-4b0c-ad30-1c177d98234d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:54.407280 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:54.407904 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:54.414114 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.414566 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.415334 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.415783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.449296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:54.449749 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:54.450265 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.objects.instance [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lazy-loading 'fault' on Instance uuid 1be70688-3d27-409d-b1fb-66932bb50757 {{(pid=118029) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 09:13:54.496274 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:54.503400 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-28517bfe-6fb7-4166-83fb-43cdad332089 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 200 len: 1184 microversion: 2.1 time: 0.100765 Jun 22 09:13:54.504075 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 536/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:54 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 1184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:55.520667 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:55.521276 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:55.528007 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.528461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.529220 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.529658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.543300 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] HTTP exception thrown: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Request method failure captured: Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 HTTP/1.1 Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistypjSDW7S2IASwrXELRsAcP-yhu6xFb2yfGJ5TZUz50iOOMg1WPEbyMvdXyMEuDxkeuHh9vOMWm7XlrjmrccqZFp3tpS6J81YZ4y71DWfDkhW5Y7EYQsyWU0U0qMJG_OzRIcdgLD8iYCTmG5Obchwy6JVmYaRmreDfbi5sb3mARLFk Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:13:55.544799 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}] Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-TestVolumeBootPattern-487095003 Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 23089387f4fd454c9a785ff4d51f48c5 Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:13:55.546986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '1be70688-3d27-409d-b1fb-66932bb50757'} Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:55.547914 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:13:55.549359 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.550728 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Returning 404 to user: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:55.550728 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a82a1d7f-2ffc-49ab-9cf6-6f8ce0b6b69c tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 404 len: 111 microversion: 2.1 time: 0.030277 Jun 22 09:13:55.550728 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 542/1078] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:55 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:13:55.620678 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1187347546", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1710909103", "security_groups": [{"name": "tempest-secgroup-smoke-613264113"}], "block_device_mapping_v2": [{"uuid": "244d72e2-b0da-43ec-8896-fea9fa1c8837", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d777f017-a4b7-4bab-b97e-75143e410eba"}]}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:13:55.624737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:55.625235 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:55.631341 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.631791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.632551 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.632986 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.647216 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] HTTP exception thrown: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Request method failure captured: Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 HTTP/1.1 Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistxTeAewBFfDek9IOQDxJ6MWzUEcfPyO7SW5987sAlAva-bKGnQOU8QsnG4-jTW-JX_SoqIQw8YWRB-2wIHjNT4CaUk98qasCpV1Ck5AL6AvzbvrCH_jtPH3qQoF9Wp-kQFE_nH6ya9yvG9L65DShriTrDAJJ-5h_wca9DhW4hsc0TM Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:13:55.648768 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}] Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 322de5283c4e40ebb3911456f96812cb Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.650171 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'bcd2ba2e-895b-47db-a4c2-fdd8d75dc726'} Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:55.651073 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.652501 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.653937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Returning 404 to user: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:55.653937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-70473f00-c068-4095-9d6c-90ab822a2780 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 404 len: 111 microversion: 2.1 time: 0.029971 Jun 22 09:13:55.653937 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 543/1079] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:13:55 2022] DELETE /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:13:55.658856 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:55.659465 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] [instance: bcd2ba2e-895b-47db-a4c2-fdd8d75dc726] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:55.665367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.665818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.666609 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:55.667042 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:55.681481 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] HTTP exception thrown: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Request method failure captured: Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 HTTP/1.1 Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistxTeAewBFfDek9IOQDxJ6MWzUEcfPyO7SW5987sAlAva-bKGnQOU8QsnG4-jTW-JX_SoqIQw8YWRB-2wIHjNT4CaUk98qasCpV1Ck5AL6AvzbvrCH_jtPH3qQoF9Wp-kQFE_nH6ya9yvG9L65DShriTrDAJJ-5h_wca9DhW4hsc0TM Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:13:55.683054 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_39db61e788d04620a94bb0ddea0cd726"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/39db61e788d04620a94bb0ddea0cd726"}]}] Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 39db61e788d04620a94bb0ddea0cd726 Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633040302 Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 322de5283c4e40ebb3911456f96812cb Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-AttachVolumeTestJSON-633040302-project Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.684574 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': 'bcd2ba2e-895b-47db-a4c2-fdd8d75dc726'} Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:13:55.685439 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. Jun 22 09:13:55.686818 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:13:55.687927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] Returning 404 to user: Instance bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:13:55.687927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3c694149-9cd8-4118-928a-fe4af5f1c695 tempest-AttachVolumeTestJSON-633040302 tempest-AttachVolumeTestJSON-633040302-project] 10.222.0.36 "GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726" status: 404 len: 111 microversion: 2.1 time: 0.029755 Jun 22 09:13:55.687927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 544/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:55 2022] GET /compute/v2.1/servers/bcd2ba2e-895b-47db-a4c2-fdd8d75dc726 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 09:13:56.004223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] validate_networks() for [('d777f017-a4b7-4bab-b97e-75143e410eba', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:13:56.183557 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:56.376471 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:13:56.376952 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:13:56.377438 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:13:56.377851 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:13:56.378394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:13:56.387281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.387730 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.388530 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:56.389437 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:56.396258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:56.407446 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for project 0c6571a499a0498abe9211d2d252bacf. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:13:56.411457 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for user 23089387f4fd454c9a785ff4d51f48c5 and project 0c6571a499a0498abe9211d2d252bacf. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:13:56.475180 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:13:56.477270 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='244d72e2-b0da-43ec-8896-fea9fa1c8837',volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:13:56.843659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-403da0a4-5ff1-4a0a-b84c-d7c4ba00885a tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.226594 Jun 22 09:13:56.846009 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 537/1081] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:13:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:13:56.855293 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b5368975-d1c3-434d-81f8-111965e414db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:56.855904 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b5368975-d1c3-434d-81f8-111965e414db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:56.916311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b5368975-d1c3-434d-81f8-111965e414db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:56.923384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b5368975-d1c3-434d-81f8-111965e414db tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1095 microversion: 2.1 time: 0.072735 Jun 22 09:13:56.923950 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 545/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:56 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:57.941967 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:57.942920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:57.949847 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.953716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:57.953716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:57.953716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:58.048261 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:58.050897 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-f3fadca9-227b-4f7e-9186-17652c7470a9 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1137 microversion: 2.1 time: 0.113727 Jun 22 09:13:58.054189 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 538/1083] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:57 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1137 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:13:59.068787 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:13:59.070130 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:13:59.078105 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:59.078546 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:59.080107 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:13:59.080547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:13:59.181390 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:13:59.190688 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-63cbb9ff-e765-4e90-a50b-ee54e756aefe tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1211 microversion: 2.1 time: 0.125754 Jun 22 09:13:59.191622 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 546/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:13:59 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:00.215258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:00.215882 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:00.225601 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:00.226074 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:00.227053 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:00.227328 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:00.485475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:00.493323 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0c583d7b-0cfb-4acc-b55a-62dc4f74e5fd tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.281940 Jun 22 09:14:00.493887 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 539/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:00 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:00.986850 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-ce7aec71-30da-4352-b973-99f531d49806 req-f168ff3c-dabc-4228-9106-3d702907bd55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced17801-19ec-423e-a501-e9614fca098c", "tag": "461d758a-f4c6-44e7-8751-b99bcc12691c"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:00.996724 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-ce7aec71-30da-4352-b973-99f531d49806 req-f168ff3c-dabc-4228-9106-3d702907bd55 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:00.997295 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-ce7aec71-30da-4352-b973-99f531d49806 req-f168ff3c-dabc-4228-9106-3d702907bd55 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:01.011271 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-ce7aec71-30da-4352-b973-99f531d49806 req-f168ff3c-dabc-4228-9106-3d702907bd55 service nova] Creating event network-changed:461d758a-f4c6-44e7-8751-b99bcc12691c for instance ced17801-19ec-423e-a501-e9614fca098c on hv-cinder-78729 Jun 22 09:14:01.016872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-ce7aec71-30da-4352-b973-99f531d49806 req-f168ff3c-dabc-4228-9106-3d702907bd55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033574 Jun 22 09:14:01.017666 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 547/1086] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:01.511202 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:01.512371 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:01.521659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:01.521659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:01.521659 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:01.522301 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:01.743995 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:01.751834 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-c85eb63e-4e0a-458f-9a1e-8d4f9099d285 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.245212 Jun 22 09:14:01.752405 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 540/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:01 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:02.769062 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:02.769758 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:02.775964 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:02.776406 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:02.777183 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:02.777592 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:02.797064 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:02.917666 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:02.925307 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e1f1a4f3-168e-43bc-90f9-fd174c8ab3c3 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.161024 Jun 22 09:14:02.925863 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 548/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:02 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:03.942815 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:03.943421 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:03.949809 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:03.950293 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:03.951049 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:03.951477 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:04.081764 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:04.089372 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-28db02ed-3865-4fc8-a42b-22cc82114c1d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.151170 Jun 22 09:14:04.089989 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 541/1089] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:03 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:05.106628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:05.107235 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:05.114408 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:05.114859 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:05.115604 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:05.116060 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:05.246033 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:05.254511 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-95b9ab49-4ac7-40b1-ab82-152d0ef62806 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.152117 Jun 22 09:14:05.255125 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 549/1090] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:05 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:06.271633 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:06.272223 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:06.278160 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:06.278600 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:06.279348 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:06.279776 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:06.397013 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:06.414766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:06.418034 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=6 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:06.423134 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-d41d8dee-5230-446c-b711-3b6b41827dea tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.155693 Jun 22 09:14:06.423695 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 542/1091] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:06 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:14:07.439440 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:07.440144 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:07.442579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=2 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:07.443233 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:07.447905 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:07.448345 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:07.449095 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:07.449533 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:07.579954 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:07.587526 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-93d8c9a6-8904-44be-9d76-0df09df0c83f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.152511 Jun 22 09:14:07.592922 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 550/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:07 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:08.604863 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:08.605394 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:08.612537 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:08.612979 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:08.613727 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:08.614181 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:08.747748 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:08.756006 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0dafa79c-1953-4ed9-ab23-32b4417a14b0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.155499 Jun 22 09:14:08.756574 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 543/1093] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:08 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:09.773619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:09.774444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:09.781597 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:09.781846 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:09.783358 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:09.783838 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:09.920300 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:09.928174 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-97d4ada7-08d6-4c8a-b7e2-e46d8e26792b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.158736 Jun 22 09:14:09.928744 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 551/1094] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:09 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:10.947342 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:10.948167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:10.955986 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:10.956442 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:10.957224 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:10.957660 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:11.110246 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:11.118684 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-30f33838-1f8e-4b3f-900d-444d44b0623d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.176621 Jun 22 09:14:11.119387 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 544/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:10 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:12.136509 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:12.137037 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:12.143807 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:12.144255 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:12.147762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:12.147762 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:12.277305 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:12.286032 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-6152c402-8ba2-48be-b4bb-48d460f6431f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.153806 Jun 22 09:14:12.286646 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 552/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:12 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:13.158353 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-76355889-95d7-4bc5-b9eb-32ff7117c861 req-ec210781-6cda-4e6b-95c1-af1ef4f9c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced17801-19ec-423e-a501-e9614fca098c", "name": "network-vif-plugged", "status": "completed", "tag": "461d758a-f4c6-44e7-8751-b99bcc12691c"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:13.166900 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-76355889-95d7-4bc5-b9eb-32ff7117c861 req-ec210781-6cda-4e6b-95c1-af1ef4f9c1c6 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:13.167350 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-76355889-95d7-4bc5-b9eb-32ff7117c861 req-ec210781-6cda-4e6b-95c1-af1ef4f9c1c6 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:13.178427 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-76355889-95d7-4bc5-b9eb-32ff7117c861 req-ec210781-6cda-4e6b-95c1-af1ef4f9c1c6 service nova] Creating event network-vif-plugged:461d758a-f4c6-44e7-8751-b99bcc12691c for instance ced17801-19ec-423e-a501-e9614fca098c on hv-cinder-78729 Jun 22 09:14:13.183388 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-76355889-95d7-4bc5-b9eb-32ff7117c861 req-ec210781-6cda-4e6b-95c1-af1ef4f9c1c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 Jun 22 09:14:13.184468 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 545/1097] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:14:13.304165 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:13.305537 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:13.313464 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:13.314784 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:13.315638 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:13.316132 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:13.452330 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:13.460212 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-4600b981-8cfb-4860-95a0-23c9112f3841 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.160343 Jun 22 09:14:13.460693 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 553/1098] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:13 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:14.478254 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:14.481363 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:14.485376 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:14.485833 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:14.486625 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:14.487064 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:14.629881 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:14.637780 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9506664e-42d3-42c5-9cd5-1959df6da325 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1266 microversion: 2.1 time: 0.164211 Jun 22 09:14:14.638284 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 546/1099] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:14 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:15.654480 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:15.655081 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:15.662227 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.662674 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.663435 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.663871 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.801885 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:15.809498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-607c2345-e0e6-4403-bb4e-3298149f358b tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1452 microversion: 2.1 time: 0.158895 Jun 22 09:14:15.810085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 554/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:15 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:14:15.825370 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:14:15.825968 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:14:15.833291 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.833733 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.834531 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:15.834960 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:15.967949 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:14:15.975667 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-3fca7a1a-15f5-46d4-a53c-c927b4bd7acf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1452 microversion: 2.1 time: 0.154206 Jun 22 09:14:15.976251 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 547/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:14:15 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:14:18.182775 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-4ece6ebe-d78b-4f07-8ca2-b2be2bf708bf req-a3975f39-42d7-45ef-aaa3-04b7baf7ffda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced17801-19ec-423e-a501-e9614fca098c", "tag": "461d758a-f4c6-44e7-8751-b99bcc12691c"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:14:18.192658 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-4ece6ebe-d78b-4f07-8ca2-b2be2bf708bf req-a3975f39-42d7-45ef-aaa3-04b7baf7ffda service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:14:18.193177 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-4ece6ebe-d78b-4f07-8ca2-b2be2bf708bf req-a3975f39-42d7-45ef-aaa3-04b7baf7ffda service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:14:18.204701 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-4ece6ebe-d78b-4f07-8ca2-b2be2bf708bf req-a3975f39-42d7-45ef-aaa3-04b7baf7ffda service nova] Creating event network-changed:461d758a-f4c6-44e7-8751-b99bcc12691c for instance ced17801-19ec-423e-a501-e9614fca098c on hv-cinder-78729 Jun 22 09:14:18.210676 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-4ece6ebe-d78b-4f07-8ca2-b2be2bf708bf req-a3975f39-42d7-45ef-aaa3-04b7baf7ffda service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031504 Jun 22 09:14:18.211279 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 555/1102] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:15:51.245766 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:15:51.246379 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Wed Jun 22 09:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:15:54.022105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [752a3f21-1861-4c87-a6b2-447cfda6a6ef] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 09:15:54.022710 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:54.023553 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=57 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:54.027333 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-354166500", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1710909103", "security_groups": [{"name": "tempest-secgroup-smoke-613264113"}], "block_device_mapping_v2": [{"uuid": "4e804ea2-5eef-46d8-8934-76436249e1cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d777f017-a4b7-4bab-b97e-75143e410eba"}]}} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:15:54.323138 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.network.neutron [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] validate_networks() for [('d777f017-a4b7-4bab-b97e-75143e410eba', None, None, None, None, None)] {{(pid=118029) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 09:15:54.696471 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Flavor limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 09:15:54.696902 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Image limits 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 09:15:54.697375 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Flavor pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 09:15:54.697782 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Image pref 0:0:0 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 09:15:54.698220 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.virt.hardware [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118029) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 09:15:54.707579 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:54.708028 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:54.708824 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:54.709258 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:54.727073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for project 0c6571a499a0498abe9211d2d252bacf. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 09:15:54.730946 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.quota [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Getting quotas for user 23089387f4fd454c9a785ff4d51f48c5 and project 0c6571a499a0498abe9211d2d252bacf. Resources: {'cores', 'instances', 'ram'} {{(pid=118029) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 09:15:54.787231 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Going to run 1 instances... {{(pid=118029) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 09:15:54.789302 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e804ea2-5eef-46d8-8934-76436249e1cc',volume_size=None,volume_type=None)] {{(pid=118029) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 09:15:55.029959 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] [752a3f21-1861-4c87-a6b2-447cfda6a6ef] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45950. Jun 22 09:15:55.186840 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-ae5d043b-a1bf-43c8-a4ae-abd0a9c46256 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.166681 Jun 22 09:15:55.187489 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 548/1103] 10.222.0.36 () {60 vars in 1146 bytes} [Wed Jun 22 09:15:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 09:15:55.196267 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba783103-62f3-40c7-b639-4e7765d79f97] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 22 09:15:55.196868 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=11 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:55.197616 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=40 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:55.201925 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f0671dd3-f053-410c-9ef1-fab72c25d4ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:55.202651 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f0671dd3-f053-410c-9ef1-fab72c25d4ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:55.358379 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f0671dd3-f053-410c-9ef1-fab72c25d4ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:55.365860 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f0671dd3-f053-410c-9ef1-fab72c25d4ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1094 microversion: 2.1 time: 0.171601 Jun 22 09:15:55.366453 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 556/1104] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:55 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1094 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:56.383051 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-9f7f31ec-21a3-4991-8fa7-87cc2692a9de tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:56.383677 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-9f7f31ec-21a3-4991-8fa7-87cc2692a9de tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:56.436464 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-9f7f31ec-21a3-4991-8fa7-87cc2692a9de tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:56.443747 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-9f7f31ec-21a3-4991-8fa7-87cc2692a9de tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1094 microversion: 2.1 time: 0.065017 Jun 22 09:15:56.444299 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 549/1105] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:56 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:56.588487 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:15:56.589040 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:15:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:15:57.460977 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0ea88ed8-3e6e-4539-b6df-d775dbc2a12d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:57.461578 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0ea88ed8-3e6e-4539-b6df-d775dbc2a12d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:57.486637 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba783103-62f3-40c7-b639-4e7765d79f97] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45978. Jun 22 09:15:57.518411 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0ea88ed8-3e6e-4539-b6df-d775dbc2a12d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:57.525131 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0ea88ed8-3e6e-4539-b6df-d775dbc2a12d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1094 microversion: 2.1 time: 0.068049 Jun 22 09:15:57.525719 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 557/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:57 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:58.542434 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-73187069-af73-4028-a337-08ff53a440ac tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:58.543073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-73187069-af73-4028-a337-08ff53a440ac tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:58.599913 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-73187069-af73-4028-a337-08ff53a440ac tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:58.606450 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-73187069-af73-4028-a337-08ff53a440ac tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1094 microversion: 2.1 time: 0.067926 Jun 22 09:15:58.610517 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 550/1107] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:58 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:15:59.623348 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:15:59.623992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:15:59.631610 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.632060 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.632825 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:15:59.633261 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:15:59.676297 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:15:59.676468 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 (ip 10.222.0.36) !!! Jun 22 09:15:59.695717 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:15:59.704384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-92cb0b20-1442-44f0-b0c8-fdfd35371fe5 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1144 microversion: 2.1 time: 0.084019 Jun 22 09:15:59.705072 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 558/1108] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:15:59 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:00.721746 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:00.722384 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:00.729477 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.729919 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.730712 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:00.731179 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:00.793924 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:00.802363 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-b60d5ff2-2aef-4ad9-b9c6-829b742f9933 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1192 microversion: 2.1 time: 0.085043 Jun 22 09:16:00.802915 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 551/1109] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:00 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:01.820427 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:01.821161 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:01.829315 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.829905 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:01.830878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:01.831311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.030673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:02.041421 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-d1d32689-8364-4fd3-bb3f-00b1afc307ed tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1277 microversion: 2.1 time: 0.225393 Jun 22 09:16:02.042007 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 559/1110] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:01 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:02.732547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-072d40c9-419b-4a30-af2a-eda7a4257da0 req-c146cbc6-9871-4f3d-b625-5b72c14b64e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9917b8-8728-4bed-b5eb-e2a0c92a1f33", "tag": "0a6acdf5-61f7-4c3b-85c4-a9adfe431a96"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:02.740777 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-072d40c9-419b-4a30-af2a-eda7a4257da0 req-c146cbc6-9871-4f3d-b625-5b72c14b64e3 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:02.741218 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-072d40c9-419b-4a30-af2a-eda7a4257da0 req-c146cbc6-9871-4f3d-b625-5b72c14b64e3 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:02.754310 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-072d40c9-419b-4a30-af2a-eda7a4257da0 req-c146cbc6-9871-4f3d-b625-5b72c14b64e3 service nova] Creating event network-changed:0a6acdf5-61f7-4c3b-85c4-a9adfe431a96 for instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 on hv-cinder-78729 Jun 22 09:16:02.759592 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-072d40c9-419b-4a30-af2a-eda7a4257da0 req-c146cbc6-9871-4f3d-b625-5b72c14b64e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039037 Jun 22 09:16:02.760184 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 552/1111] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:03.059275 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:03.059887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:03.067060 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:03.067847 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:03.068277 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:03.068712 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:03.276887 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:03.286038 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9e1b84db-5d7c-4f7b-8ec4-6ff03284c379 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.230551 Jun 22 09:16:03.286628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 560/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:03 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:04.304009 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:04.304820 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:04.311690 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:04.312128 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:04.313644 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:04.314281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:04.444229 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:04.451606 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-fa517fc6-670d-40f8-a80e-f98598898ac1 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.151757 Jun 22 09:16:04.452151 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 553/1113] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:04 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:05.468400 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:05.469063 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:05.475963 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.476413 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.477173 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:05.477608 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:05.606309 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:05.615189 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-c36d9e68-d8e4-4123-bc99-fe5b51954dcc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.150676 Jun 22 09:16:05.615755 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 561/1114] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:05 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:06.632007 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:06.632610 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:06.634561 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=2 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:06.639981 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.640428 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:06.641794 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:06.642256 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:06.776976 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:06.785169 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-4303de01-e7fc-4251-9f49-e883824b8afb tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.157135 Jun 22 09:16:06.785728 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 554/1115] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:06 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:07.802101 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:07.802706 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:07.804984 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell0:SELECT=4 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:07.809753 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:07.810241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:07.810994 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:07.811423 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:07.950007 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:07.959085 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a34a8e5b-c1a3-45b7-ad3e-ce3e8a5c0b3d tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.160830 Jun 22 09:16:07.959671 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 562/1116] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:07 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:08.976191 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:08.976803 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:08.979094 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell0:SELECT=10 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:08.984003 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:08.987920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:08.987920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:08.987920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:09.119716 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:09.127738 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-0723a1c5-bf4d-40ff-86b1-a3c09d372ce2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.155477 Jun 22 09:16:09.128300 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 555/1117] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:08 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:10.144104 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:10.144673 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:10.151273 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:10.151717 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:10.152477 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:10.152903 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:10.286196 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:10.293677 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-0a44b927-519a-4bec-bd28-2bca2a4a6892 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.154142 Jun 22 09:16:10.294254 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 563/1118] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:10 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:11.311305 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:11.311915 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:11.318682 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:11.319125 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:11.319881 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:11.320351 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:11.452525 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:11.460060 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cfd53666-6b30-4322-b22d-22f6d996d07f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.152788 Jun 22 09:16:11.460608 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 556/1119] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:11 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 09:16:12.476571 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:12.477210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:12.483739 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:12.484185 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:12.485448 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:12.485886 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:12.621720 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:12.629695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-bb242322-ce83-4292-bfbe-09e3e2f22dfc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.157008 Jun 22 09:16:12.630278 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 564/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:12 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:13.708974 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:13.709591 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:13.715970 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:13.716417 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:13.717180 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:13.717606 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:13.786460 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [req-c8ee7175-cbc6-4d56-91cc-82288bbd880d req-c71a427f-cc1e-4873-bbb1-669e91d92a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9917b8-8728-4bed-b5eb-e2a0c92a1f33", "name": "network-vif-plugged", "status": "completed", "tag": "0a6acdf5-61f7-4c3b-85c4-a9adfe431a96"}]} {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:13.796777 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-c8ee7175-cbc6-4d56-91cc-82288bbd880d req-c71a427f-cc1e-4873-bbb1-669e91d92a64 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:13.797219 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [req-c8ee7175-cbc6-4d56-91cc-82288bbd880d req-c71a427f-cc1e-4873-bbb1-669e91d92a64 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:13.808927 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.compute.server_external_events [req-c8ee7175-cbc6-4d56-91cc-82288bbd880d req-c71a427f-cc1e-4873-bbb1-669e91d92a64 service nova] Creating event network-vif-plugged:0a6acdf5-61f7-4c3b-85c4-a9adfe431a96 for instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 on hv-cinder-78729 Jun 22 09:16:13.815311 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [req-c8ee7175-cbc6-4d56-91cc-82288bbd880d req-c71a427f-cc1e-4873-bbb1-669e91d92a64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032477 Jun 22 09:16:13.816380 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 565/1121] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:16:13.883874 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:13.892266 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8a0d82b9-ed3b-4c99-bb74-79ecf99b33b2 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.249904 Jun 22 09:16:13.893227 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 557/1122] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:13 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:14.909878 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:14.910593 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:14.916737 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:14.917179 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:14.917929 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:14.918386 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:15.055481 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:15.062962 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-9d5a82f1-3257-42a9-b2b0-7103ad0a6300 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1265 microversion: 2.1 time: 0.157869 Jun 22 09:16:15.063628 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 566/1123] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:14 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:16.080599 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:16.081207 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:16.087871 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.088316 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.089072 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.089535 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.220632 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:16.228243 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8ba53b9b-da85-4bcf-880c-54ab2d37a402 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1452 microversion: 2.1 time: 0.152252 Jun 22 09:16:16.228796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 558/1124] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:16 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:16.244510 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:16:16.245126 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:16:16.252810 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.253619 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.254034 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:16.254498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:16.650024 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:16:16.657491 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-e4f50c4b-610f-4c5b-a597-c5197416be58 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1452 microversion: 2.1 time: 0.416819 Jun 22 09:16:16.658042 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 567/1125] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:16:16 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1452 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:16:18.567616 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-8a2c1190-536a-462e-9841-7ecc704f7eac req-5671a9e5-7b06-4aa3-a40e-7e0700f4aa39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9917b8-8728-4bed-b5eb-e2a0c92a1f33", "tag": "0a6acdf5-61f7-4c3b-85c4-a9adfe431a96"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:16:18.576194 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-8a2c1190-536a-462e-9841-7ecc704f7eac req-5671a9e5-7b06-4aa3-a40e-7e0700f4aa39 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:16:18.576638 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-8a2c1190-536a-462e-9841-7ecc704f7eac req-5671a9e5-7b06-4aa3-a40e-7e0700f4aa39 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:16:18.587596 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-8a2c1190-536a-462e-9841-7ecc704f7eac req-5671a9e5-7b06-4aa3-a40e-7e0700f4aa39 service nova] Creating event network-changed:0a6acdf5-61f7-4c3b-85c4-a9adfe431a96 for instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 on hv-cinder-78729 Jun 22 09:16:18.592517 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-8a2c1190-536a-462e-9841-7ecc704f7eac req-5671a9e5-7b06-4aa3-a40e-7e0700f4aa39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029458 Jun 22 09:16:18.593329 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 559/1126] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:58.291902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_api:SELECT=28 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:58.291902 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG dbcounter [-] [118028] Writing DB stats nova_cell1:SELECT=56 {{(pid=118028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:58.292503 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR oslo.messaging._drivers.impl_rabbit [-] [752a3f21-1861-4c87-a6b2-447cfda6a6ef] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 22 09:17:58.292949 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:58.294547 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG dbcounter [-] [118029] Writing DB stats nova_cell1:SELECT=48 {{(pid=118029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:58.296224 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:58.296791 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:58.303128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:58.303661 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:58.304498 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:58.305143 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:58.332444 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:17:58.357064 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-f5114dfe-48fe-41b0-964b-03d83513af8c req-35ef5ce2-9026-4dd5-9387-9c604f15a94b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9917b8-8728-4bed-b5eb-e2a0c92a1f33", "tag": "0a6acdf5-61f7-4c3b-85c4-a9adfe431a96"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:17:58.365657 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-f5114dfe-48fe-41b0-964b-03d83513af8c req-35ef5ce2-9026-4dd5-9387-9c604f15a94b service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:58.366141 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-f5114dfe-48fe-41b0-964b-03d83513af8c req-35ef5ce2-9026-4dd5-9387-9c604f15a94b service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:58.378838 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-f5114dfe-48fe-41b0-964b-03d83513af8c req-35ef5ce2-9026-4dd5-9387-9c604f15a94b service nova] Creating event network-changed:0a6acdf5-61f7-4c3b-85c4-a9adfe431a96 for instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 on hv-cinder-78729 Jun 22 09:17:58.384105 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-f5114dfe-48fe-41b0-964b-03d83513af8c req-35ef5ce2-9026-4dd5-9387-9c604f15a94b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094187 Jun 22 09:17:58.386429 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 560/1127] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:17:58.702423 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-ef7e5951-7ebf-4cb8-b844-6fe2f186650e tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 204 len: 0 microversion: 2.1 time: 0.415250 Jun 22 09:17:58.704765 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 568/1128] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:17:58 2022] DELETE /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:17:58.713598 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:58.716296 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:58.722802 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:58.723281 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:58.724057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:58.724481 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:58.914877 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:17:58.924518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-6a689ef4-c1a6-4cc8-be10-d818afca7279 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1577 microversion: 2.1 time: 0.215087 Jun 22 09:17:58.925099 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 561/1129] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:58 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:17:59.943012 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:17:59.943714 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:17:59.950424 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:59.951228 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:17:59.952018 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:17:59.952461 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:00.087077 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:00.095547 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-8374f8c9-aef8-4c59-ac7d-a8afd3a7fd43 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1577 microversion: 2.1 time: 0.156872 Jun 22 09:18:00.099918 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 569/1130] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:17:59 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:00.780309 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-199eac35-dff2-4daa-9000-b08784376322 req-2cde7a8d-7fc6-44f0-bff9-35fd5226033f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9917b8-8728-4bed-b5eb-e2a0c92a1f33", "name": "network-vif-deleted", "tag": "0a6acdf5-61f7-4c3b-85c4-a9adfe431a96"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:18:00.791479 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-199eac35-dff2-4daa-9000-b08784376322 req-2cde7a8d-7fc6-44f0-bff9-35fd5226033f service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:00.791920 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-199eac35-dff2-4daa-9000-b08784376322 req-2cde7a8d-7fc6-44f0-bff9-35fd5226033f service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:00.802880 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] [752a3f21-1861-4c87-a6b2-447cfda6a6ef] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46082. Jun 22 09:18:00.804879 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-199eac35-dff2-4daa-9000-b08784376322 req-2cde7a8d-7fc6-44f0-bff9-35fd5226033f service nova] Creating event network-vif-deleted:0a6acdf5-61f7-4c3b-85c4-a9adfe431a96 for instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 on hv-cinder-78729 Jun 22 09:18:00.809768 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-199eac35-dff2-4daa-9000-b08784376322 req-2cde7a8d-7fc6-44f0-bff9-35fd5226033f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034002 Jun 22 09:18:00.810619 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 562/1131] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:18:01.113384 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:01.114190 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:01.122351 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:01.123873 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:01.124930 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:01.125375 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:01.193896 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:01.206393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-f05fbf67-a9aa-441e-b2b4-2327e80b7958 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 200 len: 1225 microversion: 2.1 time: 0.093434 Jun 22 09:18:01.206393 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 570/1132] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:01 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:02.221795 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:02.222537 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: fd9917b8-8728-4bed-b5eb-e2a0c92a1f33] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:02.228750 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:02.229194 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:02.229997 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:02.230454 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:02.243895 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] HTTP exception thrown: Instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 could not be found. Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Request method failure captured: Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 HTTP/1.1 Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistypjSDW7S2IASwrXELRsAcP-yhu6xFb2yfGJ5TZUz50iOOMg1WPEbyMvdXyMEuDxkeuHh9vOMWm7XlrjmrccqZFp3tpS6J81YZ4y71DWfDkhW5Y7EYQsyWU0U0qMJG_OzRIcdgLD8iYCTmG5Obchwy6JVmYaRmreDfbi5sb3mARLFk Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:18:02.247057 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}] Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 23089387f4fd454c9a785ff4d51f48c5 Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 could not be found. Jun 22 09:18:02.248761 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'fd9917b8-8728-4bed-b5eb-e2a0c92a1f33'} Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 could not be found. Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:18:02.249783 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 could not be found. Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 could not be found. Jun 22 09:18:02.251737 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:02.253175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Returning 404 to user: Instance fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:18:02.253175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-da5b9844-abb8-4b85-b393-20185cd031e6 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33" status: 404 len: 111 microversion: 2.1 time: 0.031000 Jun 22 09:18:02.253175 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 563/1133] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:02 2022] GET /compute/v2.1/servers/fd9917b8-8728-4bed-b5eb-e2a0c92a1f33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:18:05.608253 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-fbe41a6e-5399-4647-b03b-7357bb7372ca req-ab0d10e7-aaf3-4dc4-9df6-3a087f0a74a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced17801-19ec-423e-a501-e9614fca098c", "tag": "461d758a-f4c6-44e7-8751-b99bcc12691c"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:18:05.608992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:05.608992 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:05.620308 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.626350 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:05.626350 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.626640 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-fbe41a6e-5399-4647-b03b-7357bb7372ca req-ab0d10e7-aaf3-4dc4-9df6-3a087f0a74a7 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.626763 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:05.626863 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-fbe41a6e-5399-4647-b03b-7357bb7372ca req-ab0d10e7-aaf3-4dc4-9df6-3a087f0a74a7 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:05.645414 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-fbe41a6e-5399-4647-b03b-7357bb7372ca req-ab0d10e7-aaf3-4dc4-9df6-3a087f0a74a7 service nova] Creating event network-changed:461d758a-f4c6-44e7-8751-b99bcc12691c for instance ced17801-19ec-423e-a501-e9614fca098c on hv-cinder-78729 Jun 22 09:18:05.653809 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-fbe41a6e-5399-4647-b03b-7357bb7372ca req-ab0d10e7-aaf3-4dc4-9df6-3a087f0a74a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051248 Jun 22 09:18:05.654973 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 564/1134] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 09:18:05.663343 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Going to try to terminate instance {{(pid=118028) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 09:18:05.943210 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-1ef7d56f-2583-424d-9033-9db54d8488f0 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 204 len: 0 microversion: 2.1 time: 0.341272 Jun 22 09:18:05.943801 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 571/1135] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:18:05 2022] DELETE /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 09:18:05.952617 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:05.954030 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:05.960790 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.961244 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:05.962016 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:05.962484 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:06.105252 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.policy [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118029) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:06.113627 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-00004603-3476-46d1-9425-c0e5cc7f3ecf tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1576 microversion: 2.1 time: 0.165359 Jun 22 09:18:06.114234 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 565/1136] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:05 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:07.134527 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:07.135790 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:07.143133 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:07.143579 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:07.144346 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:07.144774 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:07.297598 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:07.305241 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-b69076d0-806c-4161-a63c-8904f1f1f814 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1576 microversion: 2.1 time: 0.176561 Jun 22 09:18:07.305802 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 572/1137] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:07 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:07.928190 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [req-42b19fba-92c0-414b-aa8e-9b939c0546ba req-d40978d6-1718-414b-9c99-c7fc0633cb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced17801-19ec-423e-a501-e9614fca098c", "name": "network-vif-deleted", "tag": "461d758a-f4c6-44e7-8751-b99bcc12691c"}]} {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 09:18:07.937642 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-42b19fba-92c0-414b-aa8e-9b939c0546ba req-d40978d6-1718-414b-9c99-c7fc0633cb73 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:07.938108 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [req-42b19fba-92c0-414b-aa8e-9b939c0546ba req-d40978d6-1718-414b-9c99-c7fc0633cb73 service nova] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:07.949358 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.compute.server_external_events [req-42b19fba-92c0-414b-aa8e-9b939c0546ba req-d40978d6-1718-414b-9c99-c7fc0633cb73 service nova] Creating event network-vif-deleted:461d758a-f4c6-44e7-8751-b99bcc12691c for instance ced17801-19ec-423e-a501-e9614fca098c on hv-cinder-78729 Jun 22 09:18:07.954835 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [req-42b19fba-92c0-414b-aa8e-9b939c0546ba req-d40978d6-1718-414b-9c99-c7fc0633cb73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030319 Jun 22 09:18:07.955444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 566/1138] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Jun 22 09:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 09:18:08.322604 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:08.323222 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:08.334516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:08.334516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:08.334516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:08.334516 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:08.400640 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.policy [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23089387f4fd454c9a785ff4d51f48c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6571a499a0498abe9211d2d252bacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118028) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 09:18:08.410207 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-a420bafc-6f1d-4f21-9dba-8a4da34ba762 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 200 len: 1226 microversion: 2.1 time: 0.091227 Jun 22 09:18:08.410795 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 573/1139] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:08 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 09:18:09.428178 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:09.428884 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: ced17801-19ec-423e-a501-e9614fca098c] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:09.435167 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.435621 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:09.437173 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.437666 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:09.450971 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] HTTP exception thrown: Instance ced17801-19ec-423e-a501-e9614fca098c could not be found. Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Request method failure captured: Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c HTTP/1.1 Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistypjSDW7S2IASwrXELRsAcP-yhu6xFb2yfGJ5TZUz50iOOMg1WPEbyMvdXyMEuDxkeuHh9vOMWm7XlrjmrccqZFp3tpS6J81YZ4y71DWfDkhW5Y7EYQsyWU0U0qMJG_OzRIcdgLD8iYCTmG5Obchwy6JVmYaRmreDfbi5sb3mARLFk Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:18:09.453518 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}] Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 23089387f4fd454c9a785ff4d51f48c5 Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance ced17801-19ec-423e-a501-e9614fca098c could not be found. Jun 22 09:18:09.455186 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': 'ced17801-19ec-423e-a501-e9614fca098c'} Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced17801-19ec-423e-a501-e9614fca098c could not be found. Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:18:09.456073 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced17801-19ec-423e-a501-e9614fca098c could not be found. Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced17801-19ec-423e-a501-e9614fca098c could not be found. Jun 22 09:18:09.457374 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:09.458588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Returning 404 to user: Instance ced17801-19ec-423e-a501-e9614fca098c could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:18:09.458588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-8d2a07c3-58a2-419c-a996-98dcafcf6acc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c" status: 404 len: 111 microversion: 2.1 time: 0.031657 Jun 22 09:18:09.458588 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 567/1140] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:09 2022] GET /compute/v2.1/servers/ced17801-19ec-423e-a501-e9614fca098c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:18:09.989381 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:09.990138 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.compute.api [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118028) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:09.996367 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.996831 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:09.997568 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:09.998000 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG oslo_concurrency.lockutils [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:10.011828 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.wsgi [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] HTTP exception thrown: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Request method failure captured: Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: request: DELETE /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 HTTP/1.1 Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept: application/json Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Accept-Encoding: identity Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Connection: close Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Length: 0 Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Content-Type: application/json Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Host: 10.222.0.36 Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Openstack-System-Scope: None Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: User-Agent: python-urllib3/1.26.9 Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Auth-Token: gAAAAABistypjSDW7S2IASwrXELRsAcP-yhu6xFb2yfGJ5TZUz50iOOMg1WPEbyMvdXyMEuDxkeuHh9vOMWm7XlrjmrccqZFp3tpS6J81YZ4y71DWfDkhW5Y7EYQsyWU0U0qMJG_OzRIcdgLD8iYCTmG5Obchwy6JVmYaRmreDfbi5sb3mARLFk Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Id: None Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Domain-Name: None Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Identity-Status: Confirmed Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Is-Admin-Project: True Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Id: default Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Domain-Name: Default Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Project-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Role: reader,member Jun 22 09:18:10.013486 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Roles: reader,member Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}] Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-Tenant-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Id: default Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Domain-Name: Default Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Id: 23089387f4fd454c9a785ff4d51f48c5 Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: X-User-Name: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: method: > Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: exception: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.015286 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: action_args: {'id': '1be70688-3d27-409d-b1fb-66932bb50757'} Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:18:10.016206 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.017644 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.020108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Returning 404 to user: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. {{(pid=118028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:18:10.020108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-087bae2a-55f6-4f5f-9e82-2476ef6ba6fc tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 404 len: 111 microversion: 2.1 time: 0.030690 Jun 22 09:18:10.020108 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 574/1141] 10.222.0.36 () {58 vars in 1238 bytes} [Wed Jun 22 09:18:09 2022] DELETE /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:18:10.023804 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '>' {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:10.024413 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.compute.api [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] [instance: 1be70688-3d27-409d-b1fb-66932bb50757] Fetching instance by UUID {{(pid=118029) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 09:18:10.030456 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:10.031472 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:10.032332 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 09:18:10.032769 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG oslo_concurrency.lockutils [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Lock "94958f18-576d-4472-bcc3-5e5788834e8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 09:18:10.046561 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.wsgi [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] HTTP exception thrown: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Request method failure captured: Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: request: GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 HTTP/1.1 Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept: application/json Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Accept-Encoding: identity Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Connection: close Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Length: 0 Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Content-Type: application/json Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Host: 10.222.0.36 Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Openstack-System-Scope: None Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: User-Agent: python-urllib3/1.26.9 Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Auth-Token: gAAAAABistypjSDW7S2IASwrXELRsAcP-yhu6xFb2yfGJ5TZUz50iOOMg1WPEbyMvdXyMEuDxkeuHh9vOMWm7XlrjmrccqZFp3tpS6J81YZ4y71DWfDkhW5Y7EYQsyWU0U0qMJG_OzRIcdgLD8iYCTmG5Obchwy6JVmYaRmreDfbi5sb3mARLFk Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Id: None Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Domain-Name: None Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Identity-Status: Confirmed Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Is-Admin-Project: True Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Id: default Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Domain-Name: Default Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Project-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Role: reader,member Jun 22 09:18:10.048739 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Roles: reader,member Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c6571a499a0498abe9211d2d252bacf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c6571a499a0498abe9211d2d252bacf"}]}] Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Id: 0c6571a499a0498abe9211d2d252bacf Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-Tenant-Name: tempest-TestVolumeBootPattern-487095003 Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Id: default Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Domain-Name: Default Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Id: 23089387f4fd454c9a785ff4d51f48c5 Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: X-User-Name: tempest-TestVolumeBootPattern-487095003-project Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: method: > Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: exception: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.050444 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: action_args: {'id': '1be70688-3d27-409d-b1fb-66932bb50757'} Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: {{(pid=118029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 09:18:10.051382 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. Jun 22 09:18:10.052943 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: ERROR nova.api.openstack.wsgi Jun 22 09:18:10.054475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: DEBUG nova.api.openstack.wsgi [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Returning 404 to user: Instance 1be70688-3d27-409d-b1fb-66932bb50757 could not be found. {{(pid=118029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 09:18:10.054475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO nova.api.openstack.requestlog [None req-cacf323e-cfec-4fc5-bf91-ee339c322622 tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757" status: 404 len: 111 microversion: 2.1 time: 0.030163 Jun 22 09:18:10.054475 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: [pid: 118029|app: 0|req: 568/1142] 10.222.0.36 () {58 vars in 1235 bytes} [Wed Jun 22 09:18:10 2022] GET /compute/v2.1/servers/1be70688-3d27-409d-b1fb-66932bb50757 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 09:18:11.581394 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: DEBUG nova.api.openstack.wsgi [None req-3f5ec541-2a61-4f4b-b4e3-b26831725b5f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] Calling method '.version_select at 0x7fb3329095e0>' {{(pid=118028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 09:18:11.686695 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO nova.api.openstack.requestlog [None req-3f5ec541-2a61-4f4b-b4e3-b26831725b5f tempest-TestVolumeBootPattern-487095003 tempest-TestVolumeBootPattern-487095003-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1710909103" status: 202 len: 0 microversion: 2.1 time: 0.109898 Jun 22 09:18:11.687290 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: [pid: 118028|app: 0|req: 575/1143] 10.222.0.36 () {58 vars in 1262 bytes} [Wed Jun 22 09:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1710909103 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 09:19:11.254796 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:19:11.255618 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Wed Jun 22 09:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:19:16.596898 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:19:16.597593 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:19:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:20:57.052978 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:20:57.053544 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Wed Jun 22 09:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:20:59.686541 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:20:59.687148 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:20:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:21:13.876255 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:21:13.876692 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Wed Jun 22 09:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:21:17.302534 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:21:17.303128 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:21:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:22:31.263385 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:22:31.263987 dv-cinder-787296-11-iscsi devstack@n-api.service[118029]: Wed Jun 22 09:22:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 09:22:36.605260 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 09:22:36.605872 dv-cinder-787296-11-iscsi devstack@n-api.service[118028]: Wed Jun 22 09:22:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!